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To  effectively  recruit  manpower,  the  U.S.  Army  uses  advertisements  to 
affect  the  knowledge,  attitudes,  and  behavioral  intentions  of  youth  and  such 
significant  influencers  as  parents.  Army  advertising  development  and  exe¬ 
cution  is  guided  by  a  positioning  statement  and  by  specific,  measurable  ob¬ 
jectives.  This  report  documents  the  design  of  the  main  survey  conducted  to 
measure  the  achievement  of  these  objectives  under  the  Army  Communications 
Objectives  Measurement  System  (ACOMS),  which  supports  Army  assessments  of 
advertising  program  strategies  and  effectiveness  and  also  supports  both  plan¬ 
ning  for  future  strategy  and  increasing  the  operational  efficiency  of  Army 
advertising  programs. 

ACOMS  has  been  developed  to  meet  the  needs  of  Army  policy  makers  and  op¬ 
erational  managers  through  a  cooperative  effort  with  a  Special  Advisory  Group 
(SAG)  of  representatives  from  the  staffs  of  the  Office  of  the  Deputy  Chief  of 
Staff  for  Personnel,  the  U.S.  Army  Recruiting  Command,  the  U.S.  Army  Reserve 
Officers'  Training  Corps  Cadet  Command,  the  Office  of  the  Chief  of  the  Army 
Reserve,  and  the  Army  National  Guard.  Funding  for  the  survey  development  was 
provided  by  the  U.S.  Army  Recruiting  Command. 

The  participation  of  the  U.S.  Army  Research  Institute  (ARI)  in  this  coop¬ 
erative  effort  is  part  of  an  ongoing  research  program  designed  to  enhance  the 
quality  of  Army  personnel.  This  work  is  an  essential  part  of  the  mission  of 
ARI 's  Manpower  and  Personnel  Policy  Research  Group  (MPPRG)  to  conduct  research 
to  improve  the  Army's  capability  to  effectively  and  efficiently  recruit  its 
personnel.  Specific  efforts  on  ACOMS  were  undertaken  at  the  direction  of  the 
Deputy  Chief  of  Staff  for  Personnel.  The  survey  design  was  briefed  to  the  SAG 
at  quarterly  in-progress  reviews  and  also  briefed  in  January  1987  to  the  Dep¬ 
uty  Chief  of  Staff  for  Personnel,  the  Commander  of  the  U.S.  Army  Recruiting 
Command,  the  Chief  of  the  Army  Reserve,  and  the  Director  of  the  Army  National 
Guard. 

The  ACOMS  survey  was  conducted  between  October  1986  and  December  1987. 
Results  of  the  survey  effort  are  forthcoming. 


EDGAR  M.  JOHNSON 
Technical  Director 
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PREFACE 


This  paper  reports  on  the  design  of  the  main  data  collection  effort  for 
Project  Image  Watch-Dog,  "Army  Communications  Objectives  Measurement  System 
(ACOMS)"  and  addresses  the  market  for  the  Army  personnel  accessioning  system 
responsible  each  year  for  obtaining  from  the  non-prior-service  youth  market 
over  200,000  volunteers  for  the  enlisted  and  warrant  officer  force.  In  addi¬ 
tion,  the  U.S.  Army  Reserve  Officers’  Training  Corps  (R0TC)  Cadet  Command  is 
responsible  for  attracting  over  37,000  high-quality  youth  as  college  freshmen 
at  4-year  colleges.  To  effectively  recruit  in  the  youth  market,  various  com¬ 
ponents  of  the  U.S.  Army  use  advertisements  to  produce  changes  in  the  knowl¬ 
edge,  attitudes,  and  behavioral  intentions  of  youth  and  such  significant  in¬ 
fluences  as  peers  and  parents.  ACOMS  was  designed  to  provide  a  measurement 
and  analysis  system  to  support  Army  assessments  of  advertising  program  effec¬ 
tiveness,  assessments  of  advertising  strategy  efficiencies,  management  of  the 
advertising  program,  and  planning  and  development  of  new  marketing  strategies 
and  segmentations. 


The  planning  for  this  research  was  initiated  in  1984.  ACOMS  developed 
out  of  work  performed  for  a  series  of  advertising  effectiveness  conferences 
directed  by  the  U.S.  Army  Recruiting  Command  (USAREC)  at  the  request  of  the 
Deputy  Chief  of  Staff  for  Personnel  (DCSPER),  who  met  with  the  Commander  of 
USAREC,  the  Chief  of  the  Army  Reserve,  the  Director  of  the  Army  National 
Guard,  and  the  Deputy  Chief  of  Staff  of  Training  and  Doctrine  Command  for  R0TC 
in  November  of  1984  to  review  the  results  of  these  conferences.  These  offi¬ 
cers  approved  the  mission  requirements  for  ACOMS  prepared  by  their  staffs  as 
well  as  the  basic  research  plan  for  ACOMS  prepared  by  the  U.S.  Army  Research 
Institute  (ARI).  The  DCSPER  directed  ARI  to  develop  and  monitor  research 
plans  and  necessary  contract  efforts  for  ACOMS  with  guidance  from  a  Special 
Advisory  Group  (SAG)  from  involved  Army  offices.  The  Defense  Manpower  Data 
Center  was  added  in  a  special  technical  advisory  capacity  before  the  first 
meeting  of  the  SAG. 


The  SAG  was  intimately  involved  in  refining  the  mission  requirements  for 
ACOMS  throughout  the  procurement  process  that  led  to  the  selection  by  ARI  in 
1985  of  Westat,  Inc.,  as  the  ACOMS  contractor.  Scientists  from  Westat  and  the 
Army  community,  together  with  many  advisors,  developed  and  refined  The  Army 
Communications  Objectives  Measurement  System  (ACOMS):  Survey  Design  (ARI 


Technical  Report  785)  and  The  Army  Communications  Objectives  Measurement  Sys¬ 
tem  ( ACOMS):  Survey  Plan  Analysis  (ARI  Technical  Report  786).  In  addition  to 
guidance  from  the  SAG,  plans  for  ACOMS  benefited  from  advice  concerning  samp¬ 
ling,  weighting,  and  estimation  from  a  Statistical  Advisory  Panel.  The  report 
describes  the  efforts  of  many  people  on  the  Westat  Project  Team  and  in  the 
Army  community. 


The  ACOMS  system  involves  more  than  just  surveys  or  other  methods  of 
data  collection.  The  analysis  and  reporting  agenda  for  ACOMS  were  set  by  Army 
users  to  ensure  that,  in  addition  to  their  own  in-house  analyses,  research 
products  would  regularly  flow  to  users  and  systematically  address  their  needs. 
Research  products  include  quarterly  reports,  annual  tabulation  volumes,  and 
interim  reports  on  interpretive  analyses  that  are  summarized  in  an  annual 
report. 
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These  reports  are  forthcoming  for  the  period  of  ACOMS  data  collection, 
October  1986  through  December  1987. 

The  text  of  the  current  report  is  substantially  unchanged  since  it  was 
released  as  Manpower  and  Personnel  Policy  Research  Group  Working  Paper  87-2 
January  1987. 


TIMOTHY  V.  ELIG 

ARI  Senior  Scientist  and 

Contracting  Officer’s  Representative 


To  improve  the  efficiency  and  effectiveness  of  Army  advertising 
communications . 


Procedure: 

Development  of  the  ACOMS  project  design  has  been  a  collaborative  enter¬ 
prise  involving  the  Westat  Project  Team,  the  Army  Research  Institute  Contract¬ 
ing  Officer’s  Representative,  the  ACOMS  Special  Advisory  Group  (SAG)  composed 
of  representatives  from  the  staffs  of  the  Office  of  the  Deputy  Chief  of  Staff 
for  Personnel,  the  U.S.  Army  Recruiting  Command,  the  U.S.  Army  Reserve  Offi¬ 
cers’  Training  Corps  Cadet  Command  and  the  Office  of  the  Chief  of  the  Army 
Reserve,  and  the  Statistical  Advisory  Panel,  a  group  of  experts  providing  the 
project  with  advice  concerning  sampling,  weighting,  and  estimation.  The  de¬ 
sign  process  began  in  September  1985  and  continued  until  the  start  of  survey 
data  collection  in  October  1986. 

The  ACOMS  project  design  was  developed  through  consideration  of  a  num¬ 
ber  of  factors.  Project  issues  and  questions  were  formulated  by  a  conceptual 
model  of  advertising  effectiveness,  a  modified  Hierarchy  of  Effects  model.  A 
review  of  background  documents  and  interviews  with  Army  personnel  provided  a 
user  orientation  in  defining  the  analytic  issues  being  addressed  by  the  sys¬ 
tem.  This  preliminary  exploration  revealed  the  diversity  and  complexity  of 
objectives  that  the  project  is  expected  to  fulfill.  Project  objectives  were 
broadened  from  assessing  the  effectiveness  of  Army  communications  objectives 
to  include  analyses  pertaining  to  Army  advertising  strategy  and  market 
segmentation. 

The  ACOMS  development  effort  has  focused  on  specifying  the  design  and 
analysis  plan  for  the  survey  component  of  ACOMS,  by  far  the  largest  component 
of  the  system.  Because  of  the  multiple  constituencies  interested  in  ACOMS, 
the  relative  priorities  among  population  groups--and  hence,  the  sampling  de- 
sign--were  major  design  issues.  Similarly,  because  of  concerns  for  cost  and 
respondent  burden,  extensive  discussion  on  the  relative  priorities  among  vari¬ 
ous  question  domains  and  the  allocation  of  specific  questions  to  particular 
subpopulations  occurred.  In  addition,  the  design  efforts  for  both  the  sample 
and  the  questionnaires  were  affected  by  the  requirement  to  maintain  compara¬ 
bility  (in  certain  key  aspects)  to  the  Youth  Attitude  Tracking  Survey  (YATS), 
which  covers  many  of  the  same  areas  related  to  an  enlistment  decision-making. 


I 


ix 


$ 

N" 


Findings: 


ACOMS  was  designed  and  implemented  to  meet  Army  objectives  through  a 
three-pronged  "Fit -Exposure-Change"  approach  involving  a  mix  of  data  collec¬ 
tion  and  analytic  approaches.  In  this  report,  the  design  of  change  measures 
is  discussed.  The  measurement  of  change,  based  on  an  on-going  telephone  sur¬ 
vey  of  a  probability  sample  of  youth  and  their  parents,  is  central  to  the 
ACOMS  project.  Youth  and  parental  samples  were  designed  to  collect  informa¬ 
tion  on  a  variety  of  topics  including  the  youth’s  plans  for  the  future,  media 
habits,  and  reactions  to  Armed  Forces  advertising. 


Utilization  of  Findings: 


ACOMS  data  collection  was  initiated  according  to  plan  in  October  1986. 
The  first  product  reporting  results  was  delivered  in  February  1987.  Data  are 
being  used  to  track  changes  over  time  in  levels  of  advertising  recall,  and 
subsequent  effects  on  the  knowledge,  attitudes,  intentions,  and  actions  of 
youth  and  their  parents.  In  addition,  the  analysis  of  ACOMS  data  permits  a 
better  understanding  of  the  lagged  and  cumulative  effects  of  advertising  and 
of  the  relationships  between  advertising  and  other  factors  that  influence  the 
eventual  enlistment  decision. 


Thus,  the  ACOMS  effort  is  contributing  to  current  development  of  beha¬ 
vioral  and  economic  models  of  enlistment  decision-making  by  the  Army  Research 
Institute.  As  better  models  of  the  enlistment  decision  process  are  developed, 
more  effective  marketing  strategies  can  be  applied  to  help  the  Army  attain  its 
annual  recruiting  goals. 


A  second  set  of  goals  involves  the  use  of  ACOMS  data  to  assess  the  Army’s 
advertising  strategy.  ACOMS  is  examining  the  extent  to  which  the  Army’s  in¬ 
tended  messages  are  actually  being  received,  and  perceived  by,  their  target 
audiences.  Advertising  strategy  is  also  being  supported  by  the  analysis  of 
ACOMS  data  to  refine  the  definitions  of  the  Army’s  major  market  segments.  Re¬ 
actions  to  advertising,  media  habits,  and  other  variables  are  being  analyzed 
for  the  major  demographic  segments  of  interest  to  the  Army’s  recruiting  cate¬ 
gories,  broken  down  by  major  regions.  Data  analysis  is  assisting  in  identify¬ 
ing  and  validating  new  segments  defined  in  both  attitudinal  and  demographic 
terms.  This  information  is  important  in  determining  the  nature  and  extent  of 
the  advertising  to  be  directed  at  each  segment. 


ACOMS  data  are  also  being  used  to  examine  "brand  differentiation"--! .e. , 
comparison  of  image  elements--at  several  levels:  differentiation  among  the 
Active  Army,  Reserve,  National  Guard,  and  ROTC  attributes;  differentiation 
between  the  Army  and  other  services’  attributes;  and  differentiation  between 
the  Army’s  position  and  distinctive  advantages  vis-a-vis  civilian  alternatives 
(i.e.,  college  and  civilian  employment).  This  information  is  helping  the  Army 
make  decisions  on  relative  emphasis  of  various  communications  about  attributes 
and  offers  of  Army  components. 
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THE  ARMY  COMMUNICATIONS  OBJECTIVES  MEASUREMENT 
SYSTEM  (ACOMS):  SURVEY  DESIGN 


Veronica  F.  Nieva 
Obi ectives 


In  an  era  when  manpower  experts  are  predicting  increased 
difficulties  for  recruiting  into  military  service,  it  becomes  even 
more  important  that  the  U.S.  Army  improve  its  understanding  and 
management  of  the  factors  that  enable  it  to  meet  its  manpower  goals. 

Advertising  communications  represent  one  such  factor. 

The  active  Army,  the  U.S.  Army  Reserve  (USAR) ,  the  Army  Reserve 
Officers'  Training  Corps  (ROTC) ,  and  the  Army  National  Guard  (ARNG) 
extensively  use  advertising  to  induce  changes  in  the  knowledge, 
attitudes,  and  behaviors  of  youth  and  their  parents.  Each  year,  the 
Army  makes  a  sizable  investment  in  the  development  and  exposure  of 
advertising  communications  intended  to  disseminate  favorable  Army 
images  and  to  increase  the  enlistment  propensity  of  eligible  youth. 

While  in-house  assessments  have  been  conducted  by  the  Army's 
main  advertising  contractor,  and  advertising  has  been  mentioned  by  ) 

other  youth  surveys  such  as  the  Youth  Attitude  Tracking  Survey  II  J 

(YATSII),  to  date  there  has  been  no  in-depth,  independent  examination  < 

of  the  effectiveness  of  Army  communications.  The  Army  Communications 
Objectives  Measurement  System  (ACOMS)  is  such  an  effort,  designed  to 
help  the  Army  monitor  and  evaluate  its  advertising  communications 
program.  The  ACOMS  is  a  multiyear  effort  that  will  provide  ongoing 
measurement  of  the  extent  to  which  Army  communications  meet  the 
communications  objectives  for  different  target  groups. 

The  objectives  of  the  ACOMS  are: 

(1)  To  support  Army  assessments  of  advertising  program 
effectiveness  in  a  timely  fashion; 

(2)  To  support  Army  assessments  of  advertising  strategy  in  an 
integrated  framework;  and 

(3)  To  support  Army  advertising  management  and  planning  for 
future  strategy. 

The  major  task  of  the  ACOMS  is  to  monitor  and  assess  the 
effectiveness  of  the  Army's  advertising  communications  program.  Data 
will  be  used  to  track  changes  over  time  in  levels  of  advertising 
recall,  and  the  subsequent  effects  on  the  knowledge,  attitudes, 
intentions,  and  actions  of  youth  and  their  parents.  In  addition,  the 
analysis  of  the  ACOMS  data  will  allow  better  understanding  of  the 
lagged  and  cumulative  effects  of  advertising  and  of  the  relationships 
between  advertising  and  other  factors  that  influence  the  eventual 
enlistment  decision. 

i 

I 

I 


1 


Thus  the  ACOMS  effort  will  contribute  to  the  development  of 
behavioral  and  economic  models  of  enlistment  decisionmaking  currently 
being  developed  by  the  U.S.  Army  Research  Institute  (ARI).  As  better 
models  of  the  enlistment  decision  process  are  developed,  more 
effective  marketing  strategies  can  be  applied  to  help  the  Army  attain 
its  annual  recruiting  goals . 

A  second  set  of  goals  for  the  ACOMS  involves  the  use  of  its  data 
to  assess  the  Army's  advertising  strategy.  The  ACOMS  will  examine 
the  extent  to  which  the  Army's  intended  messages  are  actually  being 
exposed  to,  and  perceived  by,  their  target  audiences.  Analysis  of 
the  ACOMS  data  will  also  support  advertising  strategy  to  refine  the 
definitions  of  the  Army's  major  market  segments.  Reactions  to 
advertising,  media  habits,  and  other  variables  will  be  analyzed  for 
the  major  demographic  segments  of  interest  to  the  Army's  recruiting 
categories,  broken  down  by  major  regions.  In  addition,  analytical 
effort  will  be  devoted  to  the  identification  and  validation  of  new 
segments  defined  in  both  attitudinal  and  demographic  terms.  This 
information  will  be  important  in  determining  the  nature  and  extent  of 
advertising  to  be  directed  at  each  segment. 

The  ACOMS  data  will  also  be  used  to  examine  brand 
differentiation,  i.e.,  comparison  of  image  elements,  at  several 
levels:  (a)  differentiation  among  the  active  Army,  Reserve,  National 

Guard,  and  ROTC  attributes;  (b)  differentiation  between  the  Army  and 
other  services'  attributes;  (c)  and  differentiation  between  the 
Army's  position  and  distinctive  advantages  as  compared  with  civilian 
alternatives  such  as  college  and  civilian  employment.  This 
information  will  help  the  Army  decide  on  relative  emphasis  of  various 
communications  about  different  attributes  and  offers  of  the  Army  • 
components . 

The  ACOMS  data  and  analyses  will  be  available  to  the  Army's 
communications  program  managers  in  a  real-time,  developmental 
context.  The  ACOMS  reporting  schedules  will  be  arranged  in  order  to 
provide  timely  information  to  the  Department  of  the  Army's  planning 
cycle.  Therefore,  information  on  current  topics  of  interest  and  on 
reactions  to  advertising  approaches  among  specific  populations  can  be 
incorporated  into  advertising  development  and  placement. 


Fit -Exposure -Change  Approach  to  Achieving  Objectives 

The  ACOMS  objectives  will  be  achieved  through  a  three -pronged 
Fit -Exposure -Change  approach  that  combines  data  collection  and 
analytic  measures.  Assessment  of  the  Fit  between  the  Army's  intended 
communications  messages  or  objectives  and  the  actual  message  content 
received  by  the  audience  constitutes  the  first  prong  of  the  ACOMS 
approach.  In  brief,  measures  will  be  obtained  through  message 
content  analyses  development  from  mall- intercept  interviews.  Youth 
will  be  shown  different  advertisements ,  including  active  Army 
advertisements,  and  asked  to  indicate  what  messages  they  think  the 
advertisements  were  communicating.  Even  for  the  active  Army  alone, 
different  executions  focus  on  particular  aspects  of  the  active  Army 


image  and  offer.  Thus,  the  ACOMS  will  assess  the  extent  to  which 
various  Army  print  and  television  advertising  executions  embody  the 
various  Army  advertising  objectives. 


Different  executions  are  intended  to  be  aired  at  different 
times,  corresponding  to  hypothesized  target  market  motivations.  The 
ACOMS  will  develop  Exposure  measures  from  syndicated  data  for 
television  and  print  media  (e.g.,  Arbitron  and  Mediamark)  to  assess 
how  much  each  advertisement  is  being  "exposed"  over  various  forms  of 
media.  These  data  will  be  combined  with  the  Fit  analyses  of 
advertising  message  content  to  obtain  measures  of  exposure  for  each 
Army  communication  objective. 

Finally,  Change  measures,  derived  from  telephone  surveys  of 
youth  and  parents,  will  indicate  how  audience  reactions  are  changing 
over  time,  and  the  various  factors  that  are  related  to  these  changes. 
The  measurement  of  change,  bas  .6.  on  an  ongoing  telephone  survey  of  a 
probability  sample  of  youth  and  their  parents,  forms  the  core  of  the 
ACOMS  project.  In  brief,  the  youth  and  parental  samples  will  be 
questioned  on  a  variety  of  topics,  including  the  youth's  plans  for 
the  future,  media  habits,  and  reactions  to  Armed  Forces  advertising. 
More  detailed  descriptions  of  the  sample  and  the  questionnaire  are 
contained  in  Chapter  2  (Mohadjer  &  Waksberg,  1988)  and  Chapter  4 
(Gaertner,  Nieva,  &  Allen,  1988)  of  this  report.  Data  will  be 
collected  using  a  Random  Digit  Dialing  (RDD)  telephone  survey 
methodology,  in  which  randomly  selected  telephone  numbers  are 
contacted  in  order  to  identify  households  with  eligible  youth  (i.e., 
those  who  fulfill  the  project's  age,  education,  and  nonprior- service 
requirements).  In  the  future,  a  subsample  of  these  youth  will  be 
reinterviewed  annually. 


The  ACOMS  Project  Design  Process 

The  development  of  the  ACOMS  project  design  has  been  a 
collaborative  and  interactive  enterprise  involving  the  Westat  Project 
Team,  the  ARI  Contracting  Officer's  Representative  (COR),  the  ACOMS 
Special  Advisory  Group  (SAG)  comprised  of  the  various  Army  components 
interested  in  ACOMS,  and  the  Statistical  Advisory  Panel,  a  group  of 
experts  providing  the  project  with  advice  concerning  sampling, 
weighting,  and  estimation.  The  design  process  began  in  September 

1985,  with  the  start  of  the  contract,  and  continued  intensively  for 
about  a  year  until  the  start  of  survey  data  collection  in  October 

1986.  This  document  represents  the  design  as  of  October  1986. 

Design  modifications  that  occurred  after  the  start  of  survey  data 
collection  are  therefore  not  included  in  this  report. 

The  ACOMS  project  design  was  developed  in  consideration  of  a 
number  of  factors.  The  formulation  of  project  issues  and  questions 
was  informed  by  a  conceptual  model  of  advertising  effectiveness,  a 
modified  Hierarchy  of  Effects  model  adapted  from  Fishbein  and  Azjen 
(1975).  Further,  an  extensive  background  document  review  and 
interviews  with  relevant  Army  personnel  provided  the  designers  with  a 
user-orientation  to  use  in  defining  the  analytic  issues  that  will  be 


addressed  by  the  system.  This  preliminary  exploration  revealed  the 
diversity  and  complexity  of  objectives  that  the  project  was  expected 
to  fulfill.  Notably,  the  definition  of  project  objectives  broadened 
from  its  starting  point  of  assessing  the  effectiveness  of  Army 
communications  objectives  to  include  additional  analyses  of  Army 
advertising  strategy  and  market  segmentation. 


The  main  thrust  of  the  ACOMS  development  effort  has  focused  on 
specifying  the  design  and  analysis  plan  for  the  survey  component  of 
the  ACOMS,  which  is  by  far  the  largest  component  of  the  system. 
Because  of  the  multiple  constituencies  interested  in  the  ACOMS,  the 
relative  priorities  among  population  groups- -and  hence,  the  sampling 
design- -were  a  major  design  issue.  Similarly,  there  was  extensive 
discussion  about  the  relative  priorities  amoig  various  question- 
domains,  and  on  the  allocation  of  specific  questions  to  particular 
subpopulations  because  of  concerns  about  cost  and  possible  burdens  on 
respondents.  In  addition,  both  sample  and  questionnaire  design 
efforts  were  affected  by  requirements  to  maintain  comparability  in 
certain  key  aspects  to  the  Youth  Attitude  Tracking  Survey  (YATS) , 
which  covers  many  of  the  same  areas  related  to  enlistment 
decisionmaking . 


The  design  process  is  currently  continuing  on  the  other  two 
components,  the  measurement  of  Fit  between  intended  and  actual  Army 
communications  messages ,  and  the  measurement  of  the  extent  of 
Exposure  which  each  of  these  messages  receives  in  television  and 
print  media.  The  areas  of  dominant  influence  (ADI)  special  studies, 
a  final  component  which  will  be  used  to  examine  specific  advertising 
campaigns  or  advertisements,  remains  for  further  development. 


It  should  be  emphasized  that  the  ACOMS  design  process  does  not 
end  even  with  the  completion  of  these  later  design  elements.  Because 
the  ACOMS  project  is  intended  to  provide  useful  management 
information  in  a  timely  fashion,  a  small  percentage  (10%)  of  the  main 
survey  instrument  is  variable,  or  "floating."  The  availability  of 
floating  questions  gives  the  ACOMS  the  capacity  to  respond  to  events 
as  they  occur  in  real  time.  Requests  for  development  of  these 
floating  questions  will  come  from  the  ACOMS  SAG. 


Report  Overview 


This  report  is  the  first  of  a  series  that  documents  the  ACOMS 
project  design.  It  focuses  on  the  final  design  of  the  telephone 
survey  of  youth  and  parents  that  form  the  core  of  ACOMS.  This  design 
has  evolved  through  discussions  of  priorities  and  alternative  design 
options,  and  thus  differs  to  some  degree  from  the  initial  ACOMS 
Statement  of  Work.  The  report  includes  a  survey  overview;  sample 
design;  a  descriptive  account  of  the  survey  questionnaires;  a 
description  of  data  collection  and  processing;  and  a  discussion  of 
the  formal  survey  pretest. 


The  survey  analysis  plan  will  be  presented  in  a  second  design 
report  which  discusses  the  major  analytic  issues  that  will  be 
addressed,  using  the  survey  data.  It  will  also  describe  the  basic 
design  for  the  use  of  Fit  and  Exposure  data. 
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2.  THE  ACOMS  SURVEY:  AN  OVERVIEW  OF  THE  SURVEY  DESIGN 


Veronica  F.  Nieva 
The  ACOMS  Survey  Overview 

The  Army  Communications  Objectives  Measurement  System  (ACOMS) 
survey  is  a  continuous  data  collection  effort  designed  to  monitor  the 
Army's  advertising  program  over  time.  A  national  probability  sample 
of  youth  and  their  parents  will  be  interviewed  using  computer-assisted 
telephone  interviewing  (CATI)  technology.  The  Waksberg  Random  Digit 
Dialing  (RDD)  method  will  be  used  to  locate  households  with  youth  who 
fulfill  ACOMS  eligibility  criteria. 

The  respondents  will  be  questioned  regarding  a  variety  of  issues 
related  to  advertising  and  the  enlistment  decision  process,  e.g., 
their  media  habits,  knowledge  about  various  Army  components  and 
offers,  perceptions  of  various  Army  attributes,  and  enlistment  inten¬ 
tions  and  behaviors.  The  survey  instruments  for  the  youth  and 
parental  respondents  are  divided  into  a  number  of  topical  modules,  the 
majority  of  which  are  parallel  in  form  and  content  for  the  two  groups. 
Because  of  the  nature  of  the  survey  objectives  and  pragmatic  limita¬ 
tions  on  respondent  burden,  the  instruments  have  complex  structures 
involving  branching,  random  allocation  of  questions  to  subpopulations, 
and  randomized  ordering  of  list  presentations.  To  a  great  extent, 
such  a  degree  of  instrument  complexity  was  made  possible  by  the 
sophistication  of  CATI  technology. 

The  ACOMS  survey  will  produce  a  variety  of  work  products. 
Quarterly  reports  of  ACOMS  data  will  be  .developed  to  provide  an 
ongoing  system  to  track  changes  in  the  perceptions,  attitudes,  and 
enlistment-related  intentions  and  actions  of  the  various  market 
segments  at  which  advertising  is  targeted.  In  addition,  the  survey 
data  will  be  used  to  model  the  effects  of  Army  advertising  among  youth 
and  among  linked  pairs  of  youth  and  their  parents.  Data  will  also  be 
analyzed  to  examine  the  utility  of  existing  market  segmentation 
schemes  used  by  the  Army,  as  well  as  to  identify  new  market  segments. 

The  Youth  and  Parental  Samples 

Telephone  interviews  will  be  conducted  on  a  sample  of  youth  and 
their  parents  on  a  continuing  basis  after  the  initiation  of  data 
collection.  This  section  describes  the  sample  characteristics  agreed 
upon  during  the  design  process,  which  differ  somewhat  from  the  origi¬ 
nal  specifications  stated  in  the  ACOMS  Statement  of  Work. 

The  youth  sample  for  the  ACOMS  survey  consists  of  16-  to  24-year- 
old  males  and  females  who  have  neither  served  nor  enlisted  in  the 
Armed  Forces  and  have  not  yet  graduated  from  college .  The  youth 
sample  is  divided  into  the  following  groups: 

(1)  The  Primary  Male  Sample  (PMS) :  (Annual  n-9 ,  600)  Male  high 
school  diploma  graduates  and  those  currently  enrolled  in 
regular  high  school  or  college . 


(2)  The  Secondary  Male  Sample  (SMS):  (Annual  n-850)  Male  high 
school  noncompleters  not  currently  enrolled  in  regular  high 
school  or  college. 

(3)  The  Primary  Female  Sample  (PFS) :  (Annual  n-1,  800)  Female 
high  school  diploma  graduates  and  those  currently  enrolled 
in  regular  high  school  or^ college. 

(4)  The  Secondary  Female  Sample  (SFS):  (Annual  n-150)  High 
school  noncompleters  not  currently  enrolled  in  regular  high 
school  or  college. 

(5)  Supplementary  Samples:  Hispanics  in  all  of  the  above 
categories  (Annual  n-300)  and  the  areas  of  dominant 
influence  (ADI)  supplement  (Annual  n-2,000). 

In  addition,  the  PMS  and  PFS  samples  are  further  subdivided.  All 
16-  to  20-year-old  PMS/PFS  sample  members  become  part  of  a  parental- 
linked  sample  from  which  target  youths  will  be  selected  for  an  addi¬ 
tional  interview  of  a  predesignated  parent.  Half  of  the  parental- 
1 inked  target  youths  are  designated  for  participation  in  a  longi¬ 
tudinal  sample  to  be  reinterviewed  annually. 

Two  additional  supplements  contemplated  in  the  Statement  of  Work 
were  dropped  during  the  design  phase:  the  supplementary  sample  of 
four-year  college  students,  and  a  sample  of  Vo-Tech  students.  It  was 
further  decided  that  given  the  final  sample  design,  supplementation  of 
black  youth  would  probably  not  be  required. 

The  Primary  Male  Sample  and  Primary  Female  Sample.  In  addition 
to  the  age  and  prior  service  qualifications  of  the  overall  sample, 
eligibility  for  PMS/PFS  has  an  additional  requirement  for  educational 
attainment.  As  previously  stated,  PMS/PFS  youth  are  high  school 
diploma  graduates  or  are  currently  enrolled  in  regular  high  school  or 
a  two-  or  four-year  college. 

High  school  diploma  graduates  are  defined  as  those  completing  a 
regular  high  school  diploma,  thus  excluding  those  with  a  General 
Educational  Development  (GED)  certification  of  high  school  completion, 
or  Adult  Basic  Education  (ABE)  certificates.  Those  certificate- 
holders  are  classified  as  SMS  unless  they  are  enrolled  in  a  two-  or 
four-year  college.  This  definition  is  consistent  with  definitions  for 
Recruiting  Priority  Groups.  Enrollment  status  for  youths  interviewed 
from  July  1  through  September  1  is  defined  by  the  youth's  plans  to  be 
enrolled  in  September. 

The  PMS  and  PFS  encompass  many  of  the  Army's  prime  recruiting 
groups,  not  only  for  the  active  Army  but  also  for  the  Reserve 
Officers'  Training  Corps  (ROTC) ,  the  Army  National  Guard  (ARNG)  and 
the  U.S.  Army  Reserve  (USAR) ,  and  thus  conform  to  the  research  objec¬ 
tives  for  ACOMS.  However,  this  sample  definition  is  slightly  at  vari¬ 
ance  with  the  Youth  Attitude  Tracking  Study  II  (YATS  II)  (Research 
Triangle  Institute,  1985).  Consequently,  for  reporting  purposes,  we 


define  a  subset  of  the  PMS  as  the  Primary  Male  Analytic  Sample  (PMAS) , 
consisting  of  PMS  members  who  have  not  yet  begun  their  junior  year  in 
college  and  who  are  not  enrolled  in  a  college  ROTC  program.  This 
sample  definition  is  consistent  with  YATS  II,  although  the  YATS  II 
sample  is  limited  to  interviews  conducted  during  a  restricted  period, 
currently  September  and  October. 

The  Secondary  Male  Sample  and  Secondary  Female  Sample.  Logi¬ 
cally,  these  samples  represent  the  complements  of  their  respective 
Primary  Samples,  that  is,  youths  not  currently  enrolled  in  regular 
high  school  or  college  and  not  having  earned  a  regular  high  school 
diploma.  Youth  enrolled  in  training  and  vocational -technical  non¬ 
degree  programs  are  considered  SMS  if  they  have  not  completed  a 
regular  high  school  diploma. 

The  Parental -Linked  Sample.  One  parent  in  each  household  with 
each  PMS  and  PFS  between  the  ages  of  16  and  20  will  be  interviewed. 
Parent  does  not  necessarily  imply  biological  parent,  but  may  include 
stepparents,  foster  parents,  guardians,  or  adult  relatives.  The 
respondent  is  allowed  to  self-define  the  parent,  where  appropriate. 

For  a  randomly  chosen  half  of  the  households  with  a  16-to-20-year-old 
PMS/PFS,  the  eligible  parent  will  be  female;  for  the  other  half,  the 
parent  will  be  male.  Eligible  parents  do  not  have  to  live  in  the  same 
household  as  the  target  youth. 

The  parent  will  be  interviewed  regarding  his/her  own  awareness  of 
and  attitudes  toward  Army  and  other  military  advertising,  Army  offers 
and  images ,  as  well  as  hopes  for  and  attempts  to  influence  the  target 
youth.  For  households  with  more  than  one  eligible  PMS/PFS,  one  would 
be  designated  randomly  as  the  target  youth  for  the  parental  interview. 

The  Longitudinal  Sample.  A  randomly  chosen  half  of  the  parental - 
linked  target  youths  will  be  selected  for  participation  in  the  longi¬ 
tudinal  sample.  Longitudinal  sample  youths  will  be  reinterviewed 
annually  in  the  years  following  their  original  interviews. 

The  Hispanic  Supplementary  Sample.  The  screening  for  the  main 
samples  can  be  expected  to  yield  an  insufficient  number  of  male 
Hispanic  youth  for  some  analytic  purposes.  An  additional  300  Hispanic 
males  will  therefore  be  selected  from  telephone  exchanges  containing 
high  densities  of  Hispanics. 


The  ADI  Supplement.  A  supplement  of  2,000  PMS  in  selected  Areas 
of  Dominant- Influence  (ADIs)  may  be  interviewed  at  a  future  date. 

This  supplement  will  be  used  in  special  studies  of  the  effects  of 
specific  advertising  campaigns  or  advertisements,  and  thus  could  be 
considered  as  separate  from  the  main  ACOMS  sample.  The  content  of  the 
questionnaire  for  the  ADI  sample  may  differ  from  the  main  ACOMS 
instrument,  depending  on  the  nature  of  the  campaign  or  advertisement 
to  be  assessed. 
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The  sample  will  be  selected  using  the  Waksberg  Random  Digit  Dial 
(RDD)  procedure,  which  provides  an  unbiased  representative  sample  of 
eligibles  in  telephone  households.  The  method,  which  is  described 
further  in  Chapter  3,  ACOMS  Sample  Design  (Mohadjer  and  Waksberg, 

1988) ,  involves  the  identification  of  eligible  respondents  within 
households  from  randomly  selected  clusters  of  telephone  numbers. 

The  household  screening  and  sample  selection  process  will  be 
conducted  as  a  single,  integrated  operation  for  all  population 
subgroups.  As  households  are  screened,  those  with  any  eligible 
persons  will  be  identified,  and  a  subsampling  operation  carried  out  to 
select  the  desired  number  of  sample  persons  in  each  of  the  various 
subgroups . 

At  the  time  of  sampling,  half  of  the  households  with  eligible  PMS 
and  female  sample  (FS)  (not  including  Hispanic  supplements)  will  be 
randomly  selected  for  the  parental  interviews .  One  half  of  this  group 
(therefore,  one  fourth  of  the  total  PMS  and  FS)  will  be  randomly 
selected  for  the  longitudinal  followup. 

This  basic  RDD  approach  is  expected  to  yield  the  required  sample 
sizes  for  most  population  groups  of  interest,  with  the  exception  of 
Hispanic  male  youth.  In  order  to  obtain  the  required  sample  numbers 
of  this  relatively  rare  group,  a  supplemental  sample  will  be  drawn 
from  telephone  exchanges  known  to  have  high  Hispanic  density.  The 
supplementation  method  is  also  discussed  further  in  Chapter  3. 

The  youth  sample  needed  for  the  ADI  analysis  will  be  selected 
separately.  Since  the  ADI  sample  will  be  used  to  analyze  the  effect 
of  specific  spot  advertising,  the  interviewing  will  be  coordinated 
with  the  timing  of  the  advertisements.  Essentially  the  same  methods 
will  be  used  to  select  this  sample  as  for  the  re  lar  sample,  within 
specified  ADIs. 


ACOMS  Questionnaires 


ACOMS  currently  includes  three  survey  instruments:  (a)  the 
household  screener,  (b)  the  youth  questionnaire,  and  (c)  the  parent 
questionnaire.  These  three  instruments  are  presented  as  Appendix  B  to 
this  report.  In  the  future,  a  longitudinal  questionnaire  will  be 
designed  for  youth  who  will  be  reinterviewed  annually.  Special  ques¬ 
tionnaires  may  also  be  developed  for  the  ADI  special  studies  of 
specific  campaigns  or  advertisements. 


The  household  screener.  The  household  screener  is  a  brief, 
three-minute  instrument.  The  screening  interview  is  conducted  with 
any  knowledgeable  household  member  in  order  to  locate  youth  who  are 
eligible  for  the  full  ACOMS  interview.  Since  telephone  numbers  are 
contacted  at  random,  the  screener  interview  is  used  to  identify  and 
eliminate  nonhousehold  telephone  numbers  (e.g.,  business  and  institu¬ 
tional  telephone  numbers)  as  well  as  households  that  do  not  have  youth 
that  fulfill  ACOMS  age,  education,  and  prior-service  requirements. 


The  youth  and  parental  questionnaire:  the  underlying  conceptual 
model .  The  youth  and  parental  interviews  were  designed  with  parallel 
modules  that  provide  various  measures  of  a  modified  Hierarchy  of 
Effects  model  (Fishbein  &  Azjen,  1975)  of  Army  advertising  effective¬ 
ness.  In  brief,  the  model  suggests  that  advertising  affects  multiple 
criteria  of  advertising  effectiveness  (i.e.,  recall  of  Army  advertise¬ 
ments,  positive  perceptions  about  the  Army,  positive  attitudes  towards 
Army  enlistment,  intentions  to  enlist,  and  actual  enlistment-related 
behaviors)  in  a  stepwise  process.  That  is,  advertising  affects 
recall,  which  in  turn  affects  attitudes  toward  the  Army,  which  then 
influences  actual  behaviors  related  to  enlistment. 

The  model  also  posits  the  importance  of  social  influence,  espe¬ 
cially  parental  influence,  on  the  youth's  attraction  to  the  Army. 
Parental  attitudes  towards  the  Army  are  affected  by  advertising  in  a 
stepwise  process  that  parallels  that  found  in  youth.  Eventually  these 
attitudes  are  manifested  in  actual  attempts  to  influence  their  sons 
and  daughters  to  join  the  Army.  The  model  is  described  further  in 
Chapter  4,  ACOMS  Questionnaires  (Gaertner,  Nieva,  &  Allen,  in 
preparation) . 

The  youth  questionnaire  modules.  The  youth  interview  provides 
the  major  measures  of  the  dynamics  and  effects  of  Army  advertising 
available  in  ACOMS.  In  accordance  with  the  Hierarchy  of  Effects 
model ,  the  youth  interview  is  divided  into  14  modules .  In  order  to 
achieve  a  30 -minute  average  interview,  a  complex  questionnaire  struc¬ 
ture  was  developed:  eight  questionnaire  modules  are  core  (i.e.,  asked 
of  all  respondents),  and  six  are  rotating  (i.e.,  asked  of  a  subset  of 
respondents).  Further,  as  described  later  in  this  chapter  and  in 
Chapter  4,  the  Perceptions  module  is  divided  into  sections  that  are 
allocated  to  subsamples  in  conformance  with  the  target  markets  of  the 
various  Army  components . 

The  core  modules  are : 

(1)  Education  and  Employment:  elicits  employment  history 
and  measures  of  course  content  and  school  performance 
useful  for  assessing  quality; 

(2)  Intentions  and  Propensity:  asks  for  the  respondent's 
plans  for  the  next  few  years,  and  is  constructed  to 
parallel  and  supplement  measures  of  Army  propensity  in 
YATS  II; 

(3)  Behaviors:  elicits  information  on  the  respondent's 
activities  relative  to  enlistment,  employment  and/or 
college  enrollment; 

(4)  Importance  of  Attributes:  assesses  the  importance  to 
the  respondent  of  attributes  defined  by  the  Army's 
communications  objectives.  These  items  correspond  to 
the  evaluation  component  of  the  Hierarchy  of  Effect 
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(5)  Knowledge -Recall:  asks  for  unaided  and  aided  recall  of 
Army  (by  component)  and  other  service  advertising, 
presented  in  random  order.  The  respondent  is  also 
asked  where  the  advertising  was  seen  or  heard,  what  its 
main  message  was,  and  whether  he/she  believed  and/or 
liked  it; 

(6)  Attitude  Toward  Army  Advertising:  ascertains  how  much 
the  youth  likes  and  believes  the  advertisements  he/she 
has  seen  or  heard; 

(7)  Perceptions/Beliefs:  asks  whether  the  Army  (by 
component),  other  services,  military  service  in 
general,  and/or  college  and  civilian  employment  offer 
the  attributes  defined  by  the  Army's  communications 
objectives  presented  in  random  order.  These  items 
correspond  to  beliefs  in  the  Hierarchy  of  Effects 
model;  and 

(8)  Demographics :  elicits  information  on  respondent's 
ethnicity,  marital  status,  Social  Security  number, 
socioeconomic  background,  and  current  residence 
location. 

The  rotating  modules  are: 

(9)  Media  Habits:  elicits  information  on  the  amounts  of 
television,  radio,  and  print  material  to  which  the 
respondent  is  regularly  exposed,  and  his/her  favorite 
programs  and  print  vehicles  (asked  only  of  a  randomly 
selected  half  of  all  youth  respondents) ; 

(10)  Knowledge -Slogan  Recognition:  asks  whether  the 
respondent  can  identify  slogans  used  in  Army,  other 
services,  and  joint-service  advertising  presented  in 
random  order  (asked  only  of  a  randomly  selected  half  of 
all  youth  respondents) ; 

(11)  Knowledge -Awareness :  asks  for  the  respondent's  level 
of  knowledge  concerning  Army  offers  (asked  only  of  a 
randomly  selected  half  of  all  youth  respondents); 

(12)  Parental-Location  Information:  elicits  information 
required  to  contact  parents  (asked  only  of  parental- 
1 inked  target  youth) ; 

(13)  Social  Influences:  asks  for  the  respondent's  assess¬ 
ments  of  the  attitudes  of  friends,  parents,  and  others 
toward  enlistment  (asked  only  of  parental -linked  target 
youths) ;  and 


(14)  Tracking  Information:  elicits  information  required  to 
trace  youth  selected  for  inclusion  in  the  longitudinal 
sample,  including  anticipated  changes  in  telephone 
number,  names  and  phone  numbers  of  employer  and  two 
other  people  likely  to  know  of  respondent's  whereabouts 
(asked  only  of  longitudinal  sample) . 

Thus,  the  noncore  modules  will  only  be  asked  of  particular  groups 
of  respondents:  (a)  Tracking  and  Social  Influence  will  only  be  asked 
of  target  youths  in  the  parental- linked  sample,  since  these  respon¬ 
dents  allow  the  fullest  test  of  the  social/normative  aspects  of  the 
conceptual  model;  (b)  Slogan  Recognition,  Knowledge -Awareness ,  and 
Media  Habits  modules  will  be  asked  of  only  a  randomly  selected  half  of 
all  youth  respondents,  resulting  in  substantial  time-saving. 

The  Perceptions/Belief  module  constitutes  the  core  of  the  ACOMS 
questionnaire.  The  Perceptions/Beliefs  module  contains  questions 
about  a  list  of  attributes  corresponding  to  the  main  copy  points  or 
communications  objectives  of  Army  advertising.  Respondents  are  asked 
whether  these  attributes  are  descriptive  of  10  referents  (active  Army, 
ROTC,  ARNG,  USAR,  Navy,  Marines,  Air  Force,  military  service  gener¬ 
ally,  college,  and  work)  that  the  youth  may  perceive  as  future 
options.  Since  asking  any  single  individual  to  respond  to  the 
attribute  list  for  all  10  referents  would  be  an  intolerable  burden, 
sections  of  the  Perceptions/Beliefs  module  will  be  asked  of  different 
groups  of  respondents,  defined  in  terms  of  educational  attainment  and 
career  plans.  The  allocation  plan  reflects  the  market  priorities  of 
each  of  the  Army  components  and  was  devised  in  collaboration  with  the 
SAG . 


the  parental  questionnaire.  The  parental  interview,  to  be 
conducted  with  a  predesignated  parent  of  target  youth  16-to  20-years 
of  age,  was  constructed  in  parallel  with  the  youth  interview.  It 
contains  eight  modules  in  the  following  order: 

(1)  Parental  Influence:  probes  whether  the  parent  has  discussed 
military  service  with  the  target  youth,  his/her  expectations 
for  him/her,  and  beliefs  that  military  service  is  a  good  or 
bad  idea  for  most  young  men  and  women; 

(2)  Importance  of  Attributes:  repeats  the  items  in  the  youth 
interview  which  assess  the  importance  of  attributes,  but 
asking  the  parent  about  the  importance  of  these  attributes 
for  the  target  youth; 


(3)  Media  Habits:  items  are  identical  to  those  asked  of  the 
youth,  and  focus  on  the  amounts  of  television,  radio  and 
print  material  the  parent  is  regularly  exposed  to,  and 
his/her  favorite  programs  and  print  vehicles; 

(4)  Knowledge -Recall :  questions  are  also  identical  to  those  in 
the  youth  questionnaire  and  ask  for  unaided  and  aided  recall 
of  Army  and  other  service  advertising  with  questions  in 
random  order; 
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(5)  Attitudes  Toward  Army  Advertising:  items  address  how  much 
the  parent  likes  and  believes  the  advertisements  he/she  has 
heard  or  seen,  using  the  same  items  as  those  in  the  youth 
interview; 

(6)  Perceptions:  are  probed  by  using  the  identical  questions 
asked  of  the  target  youth  about  the  extent  to  which  the  Army 
(by  component),  other  services,  military  service  in  general, 
college  and  civilian  employment  offer  the  attributes  defined 
by  the  Army's  communications  objectives; 

(7)  Knowledge -Awareness :  items  assess  the  parent's  knowledge, 
as  in  the  youth  interview,  of  Army  benefits  and  programs; 
and 

(8)  Demographics  items:  elicit  information  on  the  parent's 
ethnicity,  marital  status,  socioeconomic  background  and 
illustrates  military  experience. 

Table  1  illustrates  the  modular  structure  of  both  main  interview 
instruments.  In  essence,  the  parental  interview  adds  one  module  to 
the  youth  questionnaire  (Parental  Influence) ,  and  drops  Education  and 
Employment,  Intentions/Propensity,  Behaviors,  Social  Influences, 

Slogan  Redognition,  and  the  Parental  Location  and  Tracking  modules 
from  the  youth  interview. 


Table  1 


Questionnaire  Module  Structure 


Core  Modules 


Education  and  employment 
Intentions  and  propensity3 
Behaviors 

Importance  of  Army  attributes 
Recall  of  Army  advertisements 
Attitude  toward  Army  advertising 
Perceptions  of  Army  attributes 
Demographics 


Youth 


Parent 


aParental  questionnaire  focuses  on  parents'  opinion  on  youth 
enlistment.  ^Half  of  youth  sample  module.  cOnly  to  parental -linked 
sample. 


Data  Collection 

The  ACOMS  survey  data  collection  will  be  conducted  using  Westat's 
Computer  Assisted  Telephone  Interview  (CATI)  technology.  The  CATI 
technology  is  particularly  appropriate  for  surveys  using  complex 
instruments  like  ACOMS,  in  which  the  types  of  information  collected 
varies  for  different  types  of  respondents.  Since  the  CATI  software 
automates  the  presentation  of  different  questions  based  on  previous 
responses,  complex  questionnaire  structures  are  feasible  with  much 
lower  error  rates  than  in  the  traditional  hard-copy  telephone  inter¬ 
view  mode.  The  CATI  system  also  edits  the  survey  data  on-line,  which 
not  only  reduces  error  further  but  also  allows  for  a  much  faster 
processing  period  at  the  end  of  data  collection. 

The  interviews  are  conducted  by  a  staff  of  interviewers  in 
Westat's  Telephone  Research  Center  (TRC)  who  are  given  extensive 
training  on  general  interviewing  techniques,  on  the  operation  of  the 
CATI  system,  and  on  specific  information  regarding  the  ACOMS  project 
and  questionnaires.  Further  description  of  the  training  program  and 
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che  CATI  system  are  provided  in  Chapter  5,  Data  Collection,  and 
Processing  (Rhoads  &  Nieva,  1988) .  The  interviewer  training  manual  is 
available  in  a  separate  volume  (Westat,  1987). 


Survey  data  quality  is  ensured  through  a  combination  of  close 
"on-the-floor"  monitoring  by  TRC  supervisors  and  project  managers,  and 
an  extensive  computerized  production  and  management  information 
system.  Monitoring  is  facilitated  by  the  TRC  facilities,  which  allow 
the  shift  supervisors  to  use  extension  telephones  to  monitor  inter¬ 
viewers  and  CRTs  linked  to  the  interviewers'  stations.  In  addition,  a 
separate  monitoring  room  with  similar  equipment  is  available  for 
project  staff  and  other  interested  parties. 

The  CATI  management  and  information  system  is  an  important  tool 
for  survey  management.  It  is  an  integrated  computerized  system  which 
handles  a  variety  of  tasks,  including  sample  management  and  assignment 
(i.e.,  initial  screening  calls,  main  interviews  with  youth  and  their 
parents,  callbacks  and  refusal  conversion  efforts,  and  validation 
calls),  creation  of  a  case-audit  trail,  and  creation  of  reports  on 
production  at  the  project  and  interviewer  level.  Details  of  the  data 
collection  process  and  control  systems  are  provided  in  Chapter  5. 

Data  Processing 

The  CATI  system  shapes  not  only  the  data  collection  but  also  the 
processing  of  the  ACOMS  survey  data.  The  system  provides  on-line 
range  checks  and  consistency  edits,  thus  minimizing,  although  not 
altogether  eliminating,  the  need  for  after-the-fact  data  editing. 
Especially  in  the  early  stages  of  the  project,  and  after  each  change 
in  questionnaire  content  or  structure,  the  data  will  be  checked  after 
collection  for  possible  incomplete  and  erroneous  data. 

Additional  data  preparation  is  involved  in  the  coding  of  open- 
ended  questions  (initially  those  involving  main  messages  received  from 
Army  and  other  service  advertising)  and  the  resolution  of  inconsistent 
geographic  information.  Both  operations  are  performed  on  the  CATI 
system,  with  an  automated  transfer  of  completed  interviews  from  data 
collection  queues  to  data  preparation  queues.  the  CATI  system  also 
allows  on-line  verification  and  performs  calculation  of  reliability 
rates  for  each  coder. 

The  ACOMS  survey  data  tapes  will  be  released  quarterly  in  raw 
data  and  SAS  formats.  The  fifth  chapter  discusses  the  characteristics 
of  the  data  files  to  be  delivered  to  the  Army  Research  Institute. 
Documentation  that  will  accompany  these  files  will  include  information 
on  tape  format,  file  layouts,  a  CATI  codebook ,  SAS  PROC  CONTENTS,  and 
an  annotated  hard-copy  questionnaire.  In  addition,  at  the  end  of  each 
project  phase,  a  Users'  Manual,  intended  as  a  reference  source  for 
analysts  who  will  use  ACOMS  data,  will  be  provided.  Training  sessions 
for  analysts  will  also  be  provided  as  required. 


Formal  Pretest 


After  receiving  official  clearance  from  the  Office  of  Management 
and  Budget  to  conduct  the  survey,  a  formal  pretest  was  conducted  to 
test  the  ACOMS  training  for  interviewers,  CATI  programming  for  sample 
and  questionnaire  management,  and  the  questionnaire  structure  and 
wording.  A  total  of  98  interviews  were  conducted  over  a  six-day 
period  in  September  1986. 

Overall,  this  test  of  survey  procedures  and  materials  proceeded 
smoothly,  fulfilling  its  major  purposes  of  confirming  the  project's 
design  choices  and  alerting  the  project  staff  to  areas  that  could  be 
improved.  For  the  most  part,  the  training  materials  that  had  been 
developed  for  interviewers  required  very  little  improvement.  Ques¬ 
tionnaire  lengths  were  within  the  expected  range.  Minor  programming 
errors  were  remedied  as  they  were  discovered.  Wording  was  refined  for 
the  few  questions  which  either  the  interviewers  or  respondents  found 
confusing  or  offensive. 

The  pretest  brought  attention  to  two  areas  requiring  further 
scrutiny  in  the  main  data  collection  effort.  First,  the  eligibility 
rates  obtained  for  youth  were  somewhat  lower  than  estimated,  although 
it  is  expected  that  the  more  extensive  followup  procedures  to  be 
implemented  during  the  main  data  collection  phase  will  alleviate  the 
shortfall.  However,  data  from  the  first  quarter  will  be  examined  to 
assess  the  severity  of  this  problem.  Second,  an  apparent  tendency 
toward  response-sets  in  the  Perceptions  module  has  caused  further 
testing  of  alternative  question  formats  that  would  minimize  respondent 
boredom  with  the  long  list  of  questions  regarding  Army  and  other 
service  attributes.  Because  of  the  centrality  of  this  module  to  the 
ACOMS  questionnaire,  a  major  effort  will  be  devoted  to  improvement  of 
this  module. 
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3.  THE  ACOMS  SAMPLE  DESIGN 
Leyla  Mohadjer  and  Joseph  Waksberg 
Design  Requirements 


i 


i 


The  Army  Communications  Objectives  Measurement  System  (ACOMS) 
project  required  the  design  and  implementation  of  a  major  survey  aimed 
at  evaluating  the  effectiveness  of  Army  advertising  communications 
over  time.  The  survey  will  provide  ongoing  assessment  of  the  success 
of  Army  advertising  communications  in  meeting  its  communication  objec¬ 
tives  within  specific  population  groups  at  the  national  level  and 
within  Recruiting  Brigades  (Rctg  Bdes).  Cross-sectional  and  panel 
data  will  be  collected  over  time  using  computer-assisted  telephone 
interviewing  (CATI)  technology.  The  ACOMS  project  originally  required 
the  following  samples  to  be  selected  via  the  Waksberg  random  digit 
dialing  (RDD)  method: 


(1)  Primary  Male  Sample  (PMS)  of  9,603  nonprior  service  (NPS) 
males  who  are  16-  to  24-years -old  and  are  in  school  or  are 
high  school  graduates  (HSDGs). 


(2)  Secondary  Male  Sample  (SMS)  of  1,800  NPS  males,  16-  to  24- 
years-old,  not  currently  in  high  school  and  not  HSDGs. 


(3)  Female  Sample  (FS)  of  1,953  NPS  females,  16-  to  24-years- 
old,  in  school  or  HSDGs. 

(4)  "Influencer"  Sample  consisting  of  parents  and  teachers./ 
counselors  linked  to  the  PMS  and  the  FS . 


(5)  Longitudinal  Sample  consisting  of  one-half  of  the  parental/ 
influencer  linked  youth  sample  who  will  be  reinterviewed  in 
four  annual  followups . 

(6)  Supplementary  PMS  Sample  consisting  of  additional  Black  and 
Hispanic  youth. 

(7)  Supplementary  SMS  Sample  of  Hispanics. 


In  addition,  the  scope  of  work  provided  for  one  or  more  optional 
samples  that  employ  additional  questions  focused  on  the  U.S.  Army 
Reserve  (USAR) ,  the  Reserve  Officers'  Training  Corps  (ROTC) ,  prior 
military  service  and  in-service  personnel  issues.  These  additional 
samples  were: 

(1)  Reserve  Market  Sample  (RMS)  consisting  of  2,000  16-  to  24- 
year-old  males,  in  school  or  HSDGs,  in  16  Areas  of  Dominant 
Influence  (ADIs) . 

(2)  Posthigh  school  PMS  Supplement  consisting  of  700  respondents 
in  vocational- technical  programs  beyond  high  school,  700  in 
two-year  community  colleges,  and  2,400  in  four-year 
colleges . 
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(3)  Prior  and  In-Service  Convenience  Sample  consisting  of  1,200 
prior  service  and  in-service  individuals,  selected  in  the 
course  of  screening  for  the  other  samples. 

The  sample  design  was  developed  in  conjunction  with  the  SAG  and 
is  intended  to  reflect  the  Army's  relative  interest  in  the  various 
target  markets.  The  sample  design,  sampling  plan,  and  weighting 
procedures  were  also  reviewed  by  an  external  statistical  panel 
composed  of  sampling  statisticians:  J.  Sedransk  from  the  University 
of  Iowa,  and  G.  Kalton  from  the  University  of  Michigan. 

Several  changes  were  made  to  the  basic  and  the  optional  samples 
as  the  result  of  a  series  of  meetings  with  the  Special  Advisory  Group 
(SAG)  and  the  statistical  external  panel.  Most  changes  involved 
sample  reductions  in  response  to  SAG  priorities  and  budgetary 
concerns.  The  decisions  to  make  these  changes  were  reached  on  the 
basis  of  a  series  of  studies  that  investigated  the  cost  and  benefit  of 
each  of  the  basic  and  optional  samples. 

These  changes  were  made  to  the  sample  design  (included  are  refer¬ 
ences  to  attachments  in  Appendix  A  that  provide  information  on 
selected  studies  and  investigations  conducted  during  the  design 
process) : 

(1)  The  size  of  the  SMS  sample  was  reduced  from  1,800  to  the 
number  that  falls  into  sample.  It  is  estimated  that  the  screening 
sample  for  PMS  should  provided  about  850  SMS.  This  sample  reduction 
decision  was  reached  because  proposal  estimates  of  the  amount  of  extra 
screening  required  to  obtain  a  sample  of  1,800  SMS  (about  167,500 
screened  households)  were  not  commensurate  with  the  importance  of  the 
SMS  sample  to  the  ACOMS  project. 

(2)  The  sampling  universe  was  limited  to  the  48  contiguous 
states.  Alaska  and  Hawaii  were  excluded  from  the  sampling  frame  since 
they  are  not  targeted  for  the  Army  advertising  communications.  Puerto 
Rico  was  also  excluded  from  the  sampling  universe.  The  effects  of 
excluding  Puerto  Rico  on  the  Hispanic  sample  are  given  in  Attachment 
1,  Appendix  A. 

(3)  There  will  be  no  special  supplementation  for  students 
enrolled  in  vocational- technical  programs.  Attachments  2a  and  2b  in 
Appendix  A  explain  the  issues  involved  in  sampling  vo-tech  students. 

(4)  Requirement  (6)  of  Statement  of  Work  (SOW)  p.  8,  Amendment 
003  was  changed  to  ask  for  the  capability  of  detecting  5%  differences 
among  the  three  Hispanic-derivation  groups  (Mexican-Americans ,  Puerto 
Ricans,  and  others),  instead  of  3%.  This  change  was  adopted  for  cost 
reasons.  Attachment  3  in  Appendix  A  provided  some  information  on  the 
amount  of  screening  required  for  precision  requirement  of  3%.  It  also 
provides  a  discussion  of  how  to  supplement  the  Hispanic  sample  and  of 
alternative  universes  that  can  be  used  for  the  supplementation. 


(5)  There  will  be  no  supplementation  of  college  students,  since 
the  number  of  screeners  required  to  provide  the  college  student 
supplement  (about  114,000  screened  households)  was  considered  too 
high.  Attachment  4b  in  Appendix  A  provides  an  estimate  of  screening 
workload  if  college  students  were  to  be  supplemented. 

(6)  Prior-service  and  in-service  youth  will  not  be  interviewed, 
eliminating  the  convenience  sample. 

(7)  For  Phase  2,  the  influencer  sample  will  consist  only  of 
parents  linked  to  respondents.  The  sample  will  include  parents  of  16- 
to  20-year-old  PMS  and  PFS  (Primary  Female  Sample,  defined  in  the  same 
way  as  PMS) . 

(8)  Monthly  reports  will  only  be  prepared  in  special  cases. 
Attachment  5  in  Appendix  A  provides  a  discussion  of  alternative  ways 
of  producing  monthly  reports. 

(9)  The  Female  Sample  (FS)  will  include  in-high  school  students 
or  high  school  diploma  graduates,  as  well  as  those  who  are  not  in  high 
school  and  who  do  not  have  high  school  diplomas.  Thus  the  female 
sample  now  parallels  the  male  sample. 

The  ACOMS  sample  design  incorporated  these  revised  requirements. 

Sample  Design 


Sample  Design  Requirements 

The  respondent  universe  for  this  survey  consists  of  eligible 
persons  who  are  defined  as  those  individuals  in  households  with 
telephones  in  the  48  contiguous  states: 

(1)  Primary  Male  Sample  (PMS):  16-  to  24-year-old  males  who  are 
in  high  school  or  who  are  high  school  diploma  (HSD)  gradu¬ 
ates  but  not  graduates  of  four-year  colleges,  excluding  in- 
service  and  prior-service  population. 

(2)  Secondary  male  Sample  (SMS) :  16-  to  24-year-old  males  who 

are  not  in  high  school  and  who  do  not  have  an  HSD,  excluding 
in-service  and  prior- service  population. 

(3)  Female  Sample  (FS),  comprising  Primary  (PFS)  and  Secondary 
(SFS)  samples,  with  similar  definitions  as  given  for  the 
male  samples. 

(4)  "Influencers , "  consisting  of  parents  of  the  sampled  PMS  and 
PFS  who  are  16-  to  20-years  of  age. 


In  addition,  supplementary  samples  of  Hispanic  males  and  PMS 
males  in  Areas  of  Dominant  Influence  (ADIs)  will  be  interviewed. 
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Specific  sample  sizes  are  required  for  PMS,  FS,  Black  and 
Hispanic  (by  derivation:  Mexican- American,  Puerto  Rican,  and  others) 
males,  ADI,  and  influencer  samples.  The  size  of  the  SMS  has  not  been 
fixed  in  advance;  thus  the  SMS  sample  will  consist  of  those  who  are 
obtained  while  screening  for  the  primary  groups  of  interest.  PMS, 

SMS,  and  FS  will  be  spread  proportionally  among  the  five  U.S.  Army 
Recruiting  Command  (USAREC)  Recruiting  Brigades. 

The  sample  will  be  selected  using  the  Waksberg  RDD  procedure, 
which  provides  an  unbiased,  representative  sample  of  eligible  persons 
in  households  with  telephones  (telephone  households)  in  a  way  that 
minimizes  the  number  of  out-of-scope  telephone  numbers  that  have  to  be 
screened.  Screening  for  all  population  groups  will  be  carried  out 
simultaneously. 

Waksberg  Method  of  Random  Digit  Dialing  (RDD) 


The  sampling  method  is  based  on  the  procedure  developed  by  Joseph 
Waksberg  (1978) .  The  Waksberg  random  digit  dialing  procedure  provides 
an  unbiased  sample  of  households  with  telephones,  with  all  telephone 
numbers  having  the  same  probability  of  selection.  Further,  the  method 
is  shown  to  require  a  smaller  number  of  telephone  calls  than  the 
sampling  procedures  previously  used  for  random  digit  dialing. 

Waksberg 's  RDD  method  of  sample  selection  for  telephone  inter¬ 
views  will  therefore  significantly  reduce  the  cost  of  such  surveys,  as 
compared  to  dialing  numbers  completely  at  random.  In  dialing  numbers 
completely  at  random,  most  numbers  dialed  are  nonworking  numbers  or 
ineligible  because  they  are  numbers  in  businesses  or  other  nonresiden- 
tial  establishments.  About  75%  of  the  potential  numbers  within  exist¬ 
ing  telephone  exchanges  are  estimated  to  be  nonworking,  and  about  3% 
are  businesses  or  institutions  of  some  type.  About  20%  turn  out  to  be 
residential . 

Thus,  when  numbers  are  selected  at  random  (within  known  telephone 
exchanges),  calls  to  about  five  separate  numbers  are  needed  to  produce 
a  single  residential  unit.  In  many  cases,  the  telephone  companies  do 
not  provide  a  message  that  the  number  dialed  is  not  a  working  number, 
and  additional  checking  is  necessary  to  distinguish  between  households 
in  which  no  one  is  at  home  or  in  which  no  one  chooses  to  answer  the 
phone  ("not -at -homes")  and  nonworking  numbers,  adding  further  to  the 
cost  of  producing  completed  interviews. 

The  Waksberg  sampling  method  is  designed  to  reduce  the  number  of 
nonproductive  calls.  It  takes  advantage  of  the  fact  that  a  high 
proportion  of  nonworking  and  commercial  numbers  occur  in  consecutive 
sequences.  In  esse  e,  the  procedure  involves  first  identifying  and 
selecting  a  sample  v :  blocks  of  numbers  which  contain  working,  resi¬ 
dential  telephone  numbers  and  then  dialing  random  numbers  within  the 
selected  blocks.  More  specifically,  the  procedure  involves  a  two- 
stage  cluster  sample;  the  first  stage  comprises  clusters  of  100  tele¬ 
phone  numbers,  each  cluster  having  the  identical  first  eight  digits  in 
the  telephone  numbers;  the  second  stage  is  selecting  and  dialing  an 
individual  household. 
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For  a  self-weighting  sample,  a  constant  number  of  households  per 
cluster  is  required.  This  method,  referred  to  as  the  Standard 
Waksberg  model,  involves  choosing  an  equal  number  of  households  within 
each  cluster.  When  this  method  is  followed,  all  residential  telephone 
numbers  have  the  same  chance  of  selection,  and  thus  the  sample  is  a 
self -weighting  sample. 

The  need  for  a  constant  number  of  households  per  cluster,  how¬ 
ever,  requires  a  rather  cumbersome  series  of  steps.  Until  all  call¬ 
backs  have  been  made  for  a  telephone  number,  there  is  no  way  to  know 
if  an  additional  household  is  needed.  So  there  are  built-in  delays 
which  make  it  difficult  to  use  the  procedure  for  the  ACOMS  study  with 
the  tight  time  schedule  for  data  collection.  Therefore,  the  modified 
Waksberg  method  will  be  used  to  sample  households  in  selected 
clusters . 

The  modified  procedure  consists  of  selecting  a  constant  number  of 
telephone  numbers  per  cluster,  then  weighting  the  results  in  each 
cluster  by  a  factor  n/n^  where  n^  is  the  number  of  respondents  in  the 
cluster  and  n  is  the  average  respondents  per  cluster.  The  modified 
Waksberg  method  is  simpler,  can  be  carried  out  in  less  time,  and  is 
also  unbiased,  in  the  same  sense  as  the  original  method.  The  modified 
method  does  speed  up  the  data  collection,  but  at  the  price  of  an 
increase  in  sampling  variances.  The  sample  requires  weighting  for  the 
production  of  unbiased  estimates,  and  the  variation  in  weights 
increases  the  sampling  variances.  Our  experience  with  this  method  is 
that  the  increase  in  variance  is  in  the  range  of  10% . 

Sampling  Universe  -  The  Issue  of  Telephone  Coverage 

Random  digit  dialing,  or,  for  that  matter,  any  sample  selected  by 
telephone,  does  not  produce  a  completely  unbiased  sample  of  the  total 
population,  since  people  who  do  not  have  telephones  in  their  resi¬ 
dences  have  no  chance  of  selection.  Thornberry  and  Massey  (1983) 
describe  the  nature  of  this  bias.  If  one  examines  the  total  popula¬ 
tion  of  the  United  States,  the  size  of  the  bias  is  fairly  trivial; 
more  than  93%  of  the  population  can  be  reached  by  telephone.  However, 
as  might  be  expected,  telephone  coverage  correlates  highly  with 
income.  Essentially,  more  low- income  persons  tend  to  be  missed  in 
telephone  screening.  This,  in  effect,  results  in  higher  telephone 
penetration  for  White  persons  than  for  Blacks  (94.3%  versus  84.5%)  and 
some  geographic  variation.  Telephone  coverage  is  lower  in  the  South 
than  in  the  rest  of  the  United  States,  and  it  is  lower  in  rural  than 
in  urban  areas.  Tables  2  and  3  contain  more  information  on  character¬ 
istics  of  households  with  and  without  telephones. 

This  information  will  be  used  in  the  ACOMS  survey  to  make  post¬ 
stratification  adjustments  to  reduce  the  effects  of  the  lack  of  cover¬ 
age.  For  more  information  on  poststratification  variables,  refer  to 
this  chapter's  section  on  poststratification. 
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Table  2 


Household  Telephone  Ownership  by  Selected  Household  Characteristics 
Health  Interview  Survey,  1981 


Household  characteristics 


All  households 

Region 

Northeast 
North  central 
South 
West 

Geographic  distribution  SMSA 
3,000,000  or  more 
1,000,000-2,999,999 
500,000-999,999 
Under  250,000 
Other  urban  areas 
Rural  areas  (escept  in  SMSA) 

SMSA/Non- SMSA 

SMSA  -  central  city 

-  not  central  city 
Non- SMSA  -  nonfarm 
-  farm 

Urban/Rural  residence 
Urban 

Rural  -  farm 
Rural  -  nonfarm 

Number  of  persons  in  household 
1 
2 

3 

4 

5 

6 

7 

8  or  more 


Telephone  households 


Note .  Information  based  on  Thornberry  and  Massey  (1983) . 
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Table  3 

Percentage  Distribution  of  Persons  by  Telephone  Coverage  and  Selected 
Characteristics:  National  Health  Interview  Survey,  1981 


Characteristics 

%  in 

telephone  households 

All  persons 

93.2 

Race 

White 

94.3 

Black 

84.5 

Other 

93.0 

Sex 

Male 

92.7 

Female 

93.7 

Age 

Under  5  years 

87.4 

5-14  years 

92.3 

15-24  years 

90.2 

25-34 

92.8 

35-44 

95.0 

45-54  years 

96.2 

55-64  years 

96.5 

65-74  years 

96.8 

75  years  and  over 

96.4 

Marital  status 

Under  17  years 

91.2 

Married- Spouse  present 

95.2 

Widowed 

95.8 

Never  married 

92.1 

Divorced 

90.1 

Separated 

83.0 

Married-Spouse  absent 

84.9 

Family  income 

Less  than  $3,000 

71.6 

$3,000  -  $4,999 

80.4 

$5,000  -  $6,999 

84.2 

$7,000  -  $9,999 

85.4 

$10,000  -  $14,999 

92.3 

$15,000  -  $24,999 

96.4 

$25,000  or  more 

99.2 

Unknown 

92.3 

Note.  Information  based  on  Thornberry  and  Massey  (1983), 
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All  existing  telephone  area  codes  and  existing  telephone 
exchanges  are  listed  on  an  AT&T  computer  tape,  which  is  updated 
monthly.  A  recent  copy  of  this  tape  is  used  as  the  frame  for  the  ini¬ 
tial  sample  selection.  All  possible  next  two-digit  numbers  are  added 
to  the  set  of  three-digit  telephone  exchanges.  Thus,  a  list  is  estab¬ 
lished  of  all  possible  first  eight  digits  of  the  ten  digits  in  tele¬ 
phone  numbers.  These  eight-digit  numbers  are  treated  as  Primary 
Sampling  Units  (PSUs) .  The  sample  design  works  as  follows:  a  random 
selection  is  made  of  an  eight-digit  number  and  also  of  the  next  two 
digits.  The  completed  telephone  number  is  then  dialed.  If  the  dialed 
number  is  at  a  residential  address,  the  PSU  is  retained  in  the  sample. 
Additional  last  two  digits  are  selected  at  random  and  dialed  within 
the  same  eight-digit  group,  until  a  set  number  of  telephone  numbers  is 
reached.  If  the  original  number  called  was  not  residential,  the  PSU 
is  rejected.  Additional  PSUs  are  selected  in  the  same  way.  This 
process  is  repeated  until  a  predesignated  number  of  PSUs  is  chosen. 

Sample  Sizes 

Two  kinds  of  sample  sizes  affect  survey  operations.  The  first  is 
the  number  of  interviewed  persons  in  the  various  target  populations . 
This  number  determines  the  reliability  of  the  statistics.  The  second 
is  the  number  of  households  that  must  be  screened  to  locate  the 
desired  sample  of  eligible  persons.  First,  the  number  of  interview 
cases  (desired  sample  sizes)  for  each  subgroup  of  the  population  will 
be  presented  and  then  the  number  of  households  to  be  screened  in  order 
to  locate  the  required  number  of  eligible  persons  for  the  subgroups 
will  be  derived. 


Table  4  provides  the  desired  sample  sizes  for  the  subpopulations  of 
interest. 


Table  4 


Expected  Number  of  Respondents  in  the  Sample 


Subpopulation 

Number 

Primary  Male  Sample  (PMS) 

9,600 

Female  Sample  (FS) 

1,950 

Black 

1,200 

Hispanic 

960 

Secondary  Male  Sample  (SMS) 

850 

PMS  enrolled  in: 

Two-year  college 

700 

Four-year  college 

1,200 

Areas  of  Dominant  Influence  (ADI) 

2,000 

Parents 

5,770 

Note .  The  Black  and  Hispanic  samples  consist  of  PMS  and  SMS  who  are 
Black  or  Hispanic. 


In  order  to  attain  the  desired  number  of  interview  cases,  a 
sample  of  households  will  be  selected  for  screening  in  each  recruiting 
brigade.  The  males  and  females  16-  to  24-years  of  age  in  the  screened 
households  will  be  identified  and  subsampled,  as  appropriate,  for 
interview.  The  subsampling  rates  for  designating  the  persons  to  be 
interviewed  in  the  screened  households  is  calculated  to  provide  the 
required  sample  sizes. 

The  households  screened  for  PMS  will  provide  the  required  sample 
sizes  for  FS  and  Black  males.  This  is  based  on  the  assumption  that 
response  rate  in  Black  households  is  similar  to  that  in  other  house¬ 
holds,  and  that  there  are  no  unusual  coverage  problems  for  Blacks. 
Therefore,  supplementation  may  be  necessary  to  secure  1,200  Black 
youth  interviews  if  either  of  the  assumptions  is  wrong.  The  SMS  and 
college  sample  sizes  have  not  been  fixed  in  advance.  The  sample  for 
these  groups  will  simply  consist  of  those  who  fall  into  the  sample. 

The  Hispanic  sample,  however,  must  be  supplemented  to  provide  the 
required  sample  size.  In  the  next  paragraphs,  we  discuss  the  screen¬ 
ing  workload  necessary  to  achieve  the  desired  sample  sizes. 

PMS  sample.  The  sample  size  for  this  group  is  9,600  interviewed 
cases.  In  order  to  determine  the  screening  workload,  two  kinds  of 
data  are  needed:  (a)  the  number  of  households  to  be  screened  per 
eligible  person,  and  (b)  the  expected  response  rate.  First,  the 
annual  sample  size  at  the  national  level  will  be  discussed  and  then 
the  approach  for  geographic  areas  and  for  monthly  samples  will  be 
described. 
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Data  on  the  number  of  eligible  PMS  persons  in  telephone  house¬ 
holds  and  the  number  of  telephone  households  are  illustrated  in  Tables 
5  to  7.  Since  the  number  of  eligible  PMS  males  does  not  vary  much  by 
age  (see  Table  5),  the  total  sample  is  expected  to  consist  of  approxi¬ 
mately  equal  sample  sizes  by  age.  Therefore,  the  PMS  size  is 
controlled  only  on  the  total  number  of  males  ages  16  to  24,  without 
additional  controls  for  each  age . 

Comparisons  of  the  population  figures  in  Table  5  with  the  number 
of  households  in  Table  7,  show  that,  on  the  average,  it  takes  5.9 
households  to  locate  1  male  eligible  for  the  PMS  sample.  With  a  5.9 
to  1  screening  ratio,  it  is  necessary  to  screen  about  56,700  house¬ 
holds  to  locate  9,600  eligible  males.  A  response  rate  of  approxi¬ 
mately  80%  is  expected.  It  is  thus  necessary  to  start  off  with  a 
sample  of  about  70,000  sample  households. 

FS  sample.  A  sample  of  1,953  nonprior  service  (NPS)  females  16- 
to  24-years  of  age  are  needed  for  the  FS  sample.  The  households 
screened  for  the  PMS  will  provide  more  eligible  females  than  neces¬ 
sary;  thus  no  additional  screening  is  needed  to  obtain  the  FS. 

Black  sample.  Table  5  indicates  that  about  13%  of  the  male 
sample  will  be  Black.  Therefore,  Black  youths  will  constitute  over 
1,200  of  the  9,600  PMS  and  SMS  sample.  Supplementation  of  Blacks  is 
thus  not  necessary,  assuming  that  the  response  rate  in  Black  house¬ 
holds  is  the  same  as  other  households  and  if  there  are  no  unusual 
coverage  problems  for  Blacks.  These  assumptions  will  be  monitored  and 
corrective  measures  will  be  taken  if  warranted. 

.  SMS  sample.  The  SMS  is  a  convenience  sample.  Thus,  the  SMS 
sample  size  is  equal  to  the  number'  of  SMS  who  fall  into  the  sample. 

The  last  three  columns  of  Table  5  contain  the  age  distribution  for  the 
population  eligible  for  the  SMS  sample.  It  can  be  seen  that  a  screen¬ 
ing  sample  of  70,000  households  should  provide  a  sample  of  about  850 
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Hispanic  sample:  precision  requirements  and  sample  sizes 
required.  The  precision  requirements  for  the  Hispanic  sample  are 
specific:  the  PMS  and  SMS  sample  should  be  supplemented  on  a  monthly 

basis  so  that  the  annual  sample  includes  sufficient  Hispanics  to 
detect  at  the  .80  power  level: 

(1)  Year-to-year  changes  of  3%  in  item  response  of  Hispanics. 

(2)  Differences  of  3%  in  an  annual  cross-section  of  Hispanics 
from  Blacks  in  the  annual  sample  and  from  Whites  in  the 
annual  sample. 


(3)  Changes  year-to-year  of  5%  in  item  responses  of  Hispanics 
16-  to  17 -years  of  age  and  18-  to  19 -years  of  age. 

(4)  Changes  year-to-year  of  6%  in  item  responses  of  Hispanics 
20-  to  21-years  of  age  and  22-  to  24-years  of  age. 
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Table  5 


Table  5  Notes  (Continued) . 


Note .  Source  for  total  and  Black,  Census  Bureau  report  P25,  No.  952. 
For  Hispanic,  Westat  projections  of  1980  population  using  annual  rate 
of  change  for  Hispanic  of  3.3%  as  reported  in  Census  reports  P20,  No. 
388  and  No .  366 . 

Note .  Source  estimates  based  on  1981  data  reported  by  Thornberry  and 
Massey  (1983).  Total  telephone  rates  used  were:  12-  to  14-years  old 
92%;  15-  to  24-years  old  90%;  Black  -  85%;  Hispanics  -  84%. 

Note.  The  source  for  educational  eligibility  is  Census  report  P23,  No. 
130,  with  some  estimation.  Basically,  we  assumed  that  the  22-  to  24- 
year-olds  had  same  level  of  high  school  diploma  as  reported  for  25-  to 
34-year-olds;  12-  to  15-year-olds  were  enrolled  in  school  at  level 
shown  in  report  and  those  16-  to  21-years-old  also  were  in-between. 

The  actual  rates  used  were:  Total  males:  12-  to  13-years-old,  99%; 
14-  to  15-years-old,  98%;  16-  to  17-years-old,  92%;  18-  to  19-years- 
old,  90%;  20-  to  22-years-old,  89%;  23-  to  24-years-old,  88%.  For 
Blacks:  12-  to  13-years-old,  99%;  14-  to  15-years-old,  98%;  16-  to 

17-years-old,  92%;  18-  to  19-years-old,  85%;  20-  to  22-years-old,  82%; 
23-  to  24-years-old,  80%.  For  Hispanics:  12-  to  13-years-old,  99%; 
14-  to  15-years-old,  98%;  16-  to  17-years-old,  88%;  18-  to  19-years- 
old,  66%;  20-  to  22-years-old,  63%;  23-  to  24-years-old,  60%.  For 
NPS,  Statistical  Abstract  for  1983  indicates  there  were  952,000 
veterans  ages  18-  to  24-years-old  in  1981.  We  assumed  they  were  all 
21-  to  24-years-old,  resulting  in  a. rate  for  these  age  groups  of 
11.1%.  NPS  was  thus  taken  as  100%  for  ages  12-  to  20-years,  and  88.9% 
for  21-  to  24-year-olds. 


Table  6 

Approximate  1980  Population  and  Households  by  Recruiting  Brigade, 
Race,  and  Ethnicity  (in  thousands) 


51B11B? 

D 

Total 

Population 

in  1980 

1980 

Households 

3 

f  Rctg 

si 

)  Bgde 

Total 

Black 

Hispanic 

Total 

Black 

Hispanic 

|  1st 

54,585 

6,356 

2,707 

19,392 

2,272 

967 

a 

it i 

1 

k  2nd 

43,655 

8,133 

1,198 

15,463 

2,853 

447 

0 

| 

51,585 

•  4,702 

1,170 

18,194 

1,654 

413 

i 

38,210 

5,179 

4,150 

13,437 

2,191 

1,444 

■< 

6th 

37,144 

2,107 

5,331 

13,480 

796 

1,937 

f] 

i  Total 

225,179 

26,477 

14,556 

79,966 

9,766 

5,208 
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Table  7 

Approximate  1986  Households,  by  Recruiting  Brigade,  Race,  and 
Ethnicity  (in  thousands) 


Rctg 

Bgde 

Estimated  1986 

Total  Black  Hispanic 

Estimated  1986 
telephone  households 

Total  Black  Hispanic 

1st 

20,749 

2,545 

1,160 

19,608 

2,188 

928 

2nd 

16,491 

3,195 

500 

15,672 

2,620 

409 

4  th 

19,468 

1,852 

495 

18,398 

1,593 

425 

5  th 

14,281 

2,455 

1,733 

12,867 

2,014 

1,490 

6  th 

14,424 

892 

2,324 

13,631 

767 

1,999 

Total 

85,413 

10,939 

6,212 

80,176 

9,182 

5,251 

Note.  Approximations  result  from  assuming  the  recruiting  brigade 
conform  to  state  boundaries . 

Projection  based  on  percentage  increase  in  population  from  1980  to 
1986  adjusted  for  small  decrease  in  average  household  size. 

Estimates  assume  the  percentage  of  telephone  households  is  the  same 
as  in  1981,  as  reported  by  Thornberry  and  Massey.  Telephone  rates 
used  were:  Total  households:  94.5%  in  1st,  4th  and  6th  Rctg  Bdes; 
90.1%  in  2nd  and  5th  Rctg  Bdes.  Black  households:  85%  in  1st,  4th, 
and  6th  Rctg  Bdes;  82%  in  2nd  and  5th  Rctg  Bdes.  Hispanic  households: 
80%  in  1st  Rctg  Bde;  84%  in  2nd  Rctg  Bde;  85%  in  4th,  5th,  and  6th 
Rctg  Bdes. 


(5)  Differences  of  5%  in  item  responses  of  between  16-  to  17- 
years  of  age  and  18-  to  19  age  intervals  in  the  annual 
cross-section  of  Hispanics . 

(6)  Differences  of  5%  in  item  responses  on  an  annual  basis 
between  Hispanics  of  different  derivation  (Mexican- 
Americans,  Puerto  Ricans,  and  others)  in  the  annual  cross- 
section  of  Hispanics. 

The  requirements  are  listed  in  terms  of  power  level  and  must  be 
translated  into  requisite  sample  sizes.  The  requirements  are 
expressed  as  the  annual  samples  needed  to  detect  certain  differences 
at  the  80%  power  level.  Differences  in  both  directions  are  to  be 
examined,  so  that  a  two-tailed  test  is  appropriate.  With  the  fairly 
large  samples  to  be  analyzed,  an  80%  probability  of  detecting  a 
difference  corresponds  to  1.3  6,  where  6  is  the  standard  error  of  the 
difference  between  the  populations  compared. 

To  estimate  the  standard  errors,  assume  that  simple  random 
sampling  applies.  This  assumption  leads  to  a  small,  but  trivial 
underestimate  of  the  variance.  The  slight  underestimate  is  due  to  the 
fact  that  clusters  of  telephone  numbers  are  used  in  the  Waksberg 
sample  selection  method  and  that  the  modified  method  is  applied,  and 
these  factors  add  to  the  sample  variance.  However,  empirical  studies 
that  have  been  carried  out  indicate  that  the  effects  are  very  slight. 

The  derivations  of  the  sample  sizes  require  one  additional 
assumption.  The  sample  sizes  depend  partially  on  the  expected 
percentages.  For  example,  a  much  larger  sample  is  needed  to  detect  a 
difference  between  47%  and  50%,  than  a  difference  between  ,%  and  10%, 
although  both  differences  are  3%.  Detecting  a  difference  of  3%  when 
one  of  the  estimates  is  50%  requires  the  maximum  sample  size.  The 
conservative  position  is  to  generate  the  sample  size  necessary  to 
detect  differences  when  the  percentage  for  one  population  is  50%. 

This  is  unnecessarily  cautious  and  a  20%  item  is  used  instead.  The 
requirements  are: 

(1)  Year-to-year  changes  of  3%.  If  6d  is  the  standard  error  of 
the  difference  between  two  years,  for  the  .80  power  level,  then 

1.3od  -  .03 
dd  -  .023 

Since  both  years  are  assumed  to  have  the  same  sample  sizes, 

d2  -  2  6  where  6,  is  the  standard  error  of  an  annual  estimate. 

?  a  a 

6  ~  P9/n  where  p  is  the  percentage  being  estimated  q  -  1-p,  and  n  is 

the  annual  sample  size.  As  stated  earlier,  a  value  of  p  -  .20  will  be 
used.  Then 

(0.23)2  -  6d2  -  2  dp2  -  2pq/n  -  2x.2x.8/n 
n  -  605 

A  sample  of  605  Hispanics  is  thus  required. 
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Difference  of  3%  between  Blacks  and  Hispanics . 


6d2  -  dg2/nB  +  6H2/nH 


where  6^  is  the  standard  error  of  the  difference,  6g  and  6^  are  the 
standard  errors  of  annual  data  for  Blacks  and  Hispanics,  and  ng  and  nH 
are  the  sample  sizes  for  the  two  groups. 


Since  ng  will  be  about  1,200,  the  sample  size  of  605  Hispanics 
will  be  more  than  sufficient  to  satisfy  this  requirement. 


Difference  of  5%  in  annual  percentages  for  age- intervals  16- 


to  17 -years  of  age  and  18-  tc  19 -years  of  age.  Since  1.3  6.  -  .05  is 


needed,  by  calculating  the  same  as  in  (1),  the  sample  size  is  216. 
This  is  the  number  required  for  each  age- interval.  For  the  two  age- 
intervals,  a  total  of  432  interviews  is  needed. 


(4)  Difference  of  6%  in  annual  percentages  for  age- intervals  20- 
to  21-years  of  age  and  22-  to  24-years  of  age.  Given  1.3  6d  -  .06, 
and  calculating  as  in  (1),  n  -  150.  This  is  the  number  required  for 
each  age- interval .  For  the  two  age - intervals ,  a  total  of  300  inter¬ 
views  is  required. 


(5)  Difference  of  5%  between  age- intervals  for  16-  to  17-year- 
olds  and  18-  to  19 -year-olds.  This  requirement  will  be  exactly  satis¬ 
fied  if  requirement  (3)  is  maintained.  The  216  cases  per  age- interval 
will  provide  the  necessary  precision. 


(6)  Difference  of  5%  in  annual  percentage  for  Hispanics  >f 
different  derivation.  The  precision  requirement  is  the  same  as  (3) , 
and  the  sample  size  of  216  derived  in  (3)  applies  here  as  well. 
However,  the  sample  size  of  216  now  applies  separately  to  each 
Hispanic  derivation. 


With  three  Hispanic  groups  (Mexican-Americans ,  Puerto  Ricans,  and 
others),  the  sample  size  needed  is  64 8  Hispanics. 


(7)  Combined  effects  of  criteria  1  to  6 .  The  key  criteria  are 
(3),  (4),  and  (6).  A  sample  which  satisfies  them  will  be  more  than 
adequate  for  the  other  requirements.  It  is  necessary  to  examine  some 
details  of  the  sample  sizes  for  (3) ,  (4) ,  and  (6)  in  order  to  deter¬ 
mine  the  minimum  Hispanic  sample  that  will  satisfy  all  requirements. 
The  sample  sizes  needed  to  satisfy  requirements  (3)  and  (4)  are: 


Sample  Size  per  Age  Interval 


16-  to  17 -year-olds , 
18-  to  19-vear-olds 


20-  to  21-vear-olds , 
22-  to  24-vear-olds 


Total 
All  Ages 


B 


I 


Furthermore,  as  described  in  the  section  on  sample  sizes,  the 
sample  is  controlled  to  produce,  at  the  national  level,  a  PMS  total  of 
9,600  distributed  almost  equally  by  age.  This  distribution  implies 
that  if  the  sample  provides  216  Hispanics  16-  to  17 -years  of  age,  it 
will  also  contain  about  216  Hispanics  20-  to  21-years  of  age.  That 
is,  although  requirement  (4)  requires  150  Hispanics  20-  to  21 -years  of 
age,  about  the  same  size  sample  as  for  16-  to  17-year-olds  and  18-  to 
19-year-olds  will  be  obtained.  Assuming  the  size  of  the  sample  for 
22-  to  24-years  of  age  is  also  216,  the  sample  sizes  for  (3)  and  (4) 
will  be: 


L6-  to  17-vear-olds . 
L8-  to  19-vear-olds 


Sample  Size  per  Age  Interval 

_ 20-  to  21-vear-olds . 

_ 22-  to  24-vear-olds 


Total 
All  Ages 


The  distribution  by  Hispanic  derivation  uses  the  relationships 
illustrated  in  Table  8.  The  sample  size  that  will  meet  all  require¬ 
ments  is  960  total: 


16-  to  17-vear-olds. 
18-  to  19-vear-olds 


20-  to  21-vear-olds.  Total 

22-  to  24-vear-olds  All  Ages 


130 

, 

130 

520 

54 

54 

216 

56 

56 

224 

240 

240 

960 

Mexican- 
American 
Puerto  Rican 
Other 


Of  all  males  16-  to  24 -years  of  age  in  telephone  households  in 
the  U.S.,  about  6.5%  are  Hispanics.  Consequently,  of  10,450  sampled 
male  youth  (9,600  PMS  and  850  SMS),  about  670  will  be  Hispanics. 

Based  on  the  distribution  of  Hispanics  by  ethnic  background,  as  shown 
in  Table  8,  the  670  Hispanics  should  have  approximately  this 
distribution: 

Mexican-American  400 

Puerto  Rican  95 

Other  175 

Total  670 

Therefore,  the  screening  sample  of  70,000  households  will  have  to 
be  increased  to  provide  the  Hispanic  supplement.  The  extra  screening 
workload  for  supplementing  Hispanics  is  determined  by  the  additional 
sample  size  required  for  the  rarest  of  the  three  Hispanic  groups,  the 
Puerto  Ricans.  From  Table  8,  it  can  be  seen  that  Puerto  Ricans 


Approximate  1980  Hispanic  Population  Proportions,  by  Recruiting  Brigade  and  Ethnic  Background  (in 
thousands) 
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constitute  14%  of  all  Hispanics .  The  ratio  of  95  Puerto  Ricans  out  of 
70,000  screened  households  implies  that  to  locate  the  additional  121 
Puerto  Ricans  (216  -  95  -  121),  an  additional  sample  of  about  88,400 
household  screeners  randomly  selected  from  the  48  states  is  required. 
Sample  expansion  can  thus  be  quite  costly,  and  it  is  useful  to  explore 
alternative  ways  of  accomplishing  the  supplementation. 

Supplementation  Methods  for  Hisnanics 

There  are  basically  three  methods  of  sample  supplementation  for  a 
moderately  rare  population  such  as  Hispanics: 

(1)  Increase  the  screening  sample  to  achieve  the  desired  sample 
size,  using  the  RDD  methodology.  In  this  case  it  would  mean 
screening  2.3  times  as  large  a  sample  as  is  otherwise 
necessary. 

(2)  Stratify  the  population,  identify  geographic  areas  with 
heavy  concentrations  of  Hispanics,  and  oversample  the 
designated  strata. 

(3)  Locate  a  partial  list  of  Hispanics  (not  necessarily 
complete),  and  use  a  dual-frame  approach  to  sample  both  from 
the  list  and  by  RDD.  The  weighting  takes  into  account  the 
different  probabilities  of  selection  for  persons  on  the  list 
and  those  not  on  the.  list.  For  Hispanics,  the  list  would  be 
the  set  of  households  vfith  Spanish  surnames  in  telephone 
directories. 

The  number  of  interviews,  amount  of  screening,  and  costs  for  the 
three  different  sampling  methods  for  supplementing  the  Hispanic  sample 
were  compared.  The  comparison  was  based  on  an  optimization  procedure 
with  the  objective  of  achieving  the  desired  precision  in  the  estimate 
at  minimum  cost.  The  study  showed  that  the  cost  of  both  stratifica¬ 
tion  and  list  sampling  is  well  below  the  cost  of  straight  RDD.  There¬ 
fore,  the  first  method,  straight  RDD,  was  rejected.  The  cost  of  the 
geographic  oversampling  and  the  partial  list  methods  was  very  similar. 
However,  in  comparing  the  available  partial  list  and  the  available 
frame  for  the  stratification  method,  the  stratification  method  was 
found  to  be  superior. 

The  optimization  and  level  of  screening  and  interviewing  for  the 
Spanish  surname  procedure  was  very  sensitive  to  the  amount  of  attri¬ 
tion  in  the  surname  list.  The  study  indicated  a  15%  loss  because  some 
households  with  Spanish  surnames  are  not  Hispanic,  and  a  10%  loss  for 
other  reasons  (e.g.,  coverage  problems).  The  15%  loss  is  based  on 
census  studies  and  is  reasonably  close  to  what  will  occur  in  practice. 
The  10%  loss,  however,  was  a  guess.  The  Spanish  surname  list  avail¬ 
able  for  supplementing  Hispanics  actually  had  a  much  higher  loss  rate 
than  10%.  Therefore,  the  Spanish  surname  procedure  was  found  to  be 
much  less  efficient  than  originally  estimated. 


There  were  ocher  problems  with  the  surname  list  procedure  as 
well.  For  example,  assume  that  the  proportion  of  Hispanic  households 
with  eligible  males  in  telephone  households  was  the  same  as  in  non¬ 
telephone  households  and  that  the  nonresponse  rates  in  Hispanic  house¬ 
holds  would  be  about  the  same  as  in  all  households.  With  a  10%  loss, 
it  is  unlikely  that  these  assumptions  could  be  so  seriously  in  error 
to  have  an  important  effect  on  the  comparisons.  But  with  the 
projected  10%  loss  increasing  to  between  30%  and  40%,  the  effect  could 
be  very  serious.  Considering  these  factors,  the  area  stratification 
approach  was  chosen  to  supplement  the  Hispanic  sample.  This  method 
involves  identifying  geographic  areas  with  a  high  concentration  of 
Hispanics  and  oversampling  the  designated  areas. 

Data  from  the  1980  Census  on  the  distribution  of  Hispanics  by 
ethnic  background  and  recruiting  brigade  are  shown  in  Table  8. 

Certain  deficiencies  in  the  census  resulted  in  some  Mexican  Americans 
being  reported  as  "other  Hispanics,"  particularly  in  the  5th  and  6th 
Rctg  Bdes .  However,  the  table  does  show  the  general  pattern.  For 
Mexican-Americans ,  the  5th  and  6th  Rctg  Bdes  would  have  to  be  supple¬ 
mented,  and  for  Puerto  Ricans,  the  1st  Rctg  Bde .  The  1st,  5th  and  6th 
Rctg  Bdes  should  also  provide  the  required  supplementation  for 
Hispanics  of  other  derivations . 

The  Hispanic  youth  supplement  will  be  drawn  using  a  data  tape 
developed  by  the  Donnelley  Marketing  Information  Services.  Located  in 
Stamford,  Connecticut,  Donnelley  sells  computer  tapes  of  telephone 
exchanges  and  their  associated  demographic  characteristics.  The  tape 
for  the  U.S.  contains  1980  Census  characteristics  for  telephone 
exchanges  with  1985  updates;  it  can  be  used  to  identify  areas  with 
concentrations  of  rare  populations.  Telephone  exchanges  in  the  1st, 

5th  and  6th  Rctg  Bdes  with  heavy  concentration  of  Hispanics  will  be 
identified  and  oversampled. 

The  section  on  sample  sizes  provided  the  distribution  of  the 
required  number  of  Hispanics  by  derivation  and  the  sample  sizes  we 
expect  to  obtain  from  the  main  PMS  screening  sample  of  70,000.  The 
difference  is  the  number  that  has  to  be  supplemented: 

Main  Desired 

PMS  Sample  Sample  Sizes  Difference 


Mexican -American 

400 

520 

120 

Puerto  Rican 

95 

216 

121 

Other 

175 

224 

49 

670 

960 

290 

The  above  figures  imply  that  additional  self -weighting  samples  of  120 
Mexican-Americans,  121  Puerto  Ricans,  and  49  other  Hispanics  are 
required  to  provide  the  desired  sample  sizes. 


% 

s 


To  supplement  the  Hispanic  sample,  areas  with  heavy  concentra¬ 
tions  of  Hispanics  will  be  identified  and  oversampled.  Such  a  design 
will  have  higher  sampling  variances  than  a  sample  with  a  uniform 
sampling  rate  (self -weighting)  in  all  areas.  Therefore,  the  samples 
have  to  be  enlarged  to  compensate  for  the  increase  in  variance ,  in 
order  to  meet  the  precision  requirements  for  the  Hispanic  sample.  The 
relative  increase  in  variance  can  be  expressed  as: 


HcPi  +  P2)  (—  +  P2> 

k 


1, 


where 


proportion  of  the  total  Hispanic  population  in 
highly  concentrated  areas, 


and 


ratio  of  sampling  rate  in  the  area  with  heavy 
concentration  of  Hispanics  to  sampling  rate 
in  the  remainder  of  the  areas. 


See  Attachment  6,  Appendix  A: 
1985  for  further  information. 


Waksberg  memorandum,  December  11, 


Table  9  shows  the  concentration  of  Hispanics  and  telephone  clus¬ 
ters  in  the  1st  Rctg  Bde .  Table  8  indicates  that  the  majority  of 
Puerto  Ricans  reside  in  the  1st  Rctg  Bde.  Using  the  above  formula  for 
relative  increase  in  variance,  and  comparing  the  amount  of  oversam¬ 
pling  required  for  Puerto  Ricans  (121)  with  the  size  of  the  sample 
(95)  expected  from  the  main  PMS  sample,  it  was  concluded  that  an 
optimum  value  for  Pj^  (proportion  of  the  Puerto  Rican  population  in  the 
concentrated  areas)  is  in  the  range  of  .35  to  .40.  Considering  the 
fact  that  about  56%  of  the  Hispanics  in  the  1st  Rctg  Bde  are  Puerto 
Ricans,  as  shown  in  Table  8,  about  62%  of  Hispanics  in  the  1st  Rctg 
Bde  should  be  oversampled.  If  all  telephone  clusters  for  which  the 
concentration  of  Hispanics  is  more  than  10%  in  the  frame  for 
supplementing  Hispanics  are  included,  about  66%  of  all  Hispanics  in 
the  1st  Rctg  Bde  will  be  covered.  This  frame  will  thus  provide  the 
supplementation  for  Puerto  Ricans. 
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Table  9 

Concentration  of  Hispanics  in  Telephone  Households  in  1st  Recruiting 
Brigade 


Hispanic 

concentration 

Number  of 
telephone  clusters 

Hispanic 

population 

Cumulative  % 
of  Hispanics 

Less  than  10% 

5,578 

1,030,620 

100.0 

10  -  19% 

264 

509,700 

66.1 

20  -  29% 

145 

401,083 

49.3 

30  -  39% 

126 

442,396 

36.2 

40  -  49% 

51 

390,962 

21.6 

50  -  59% 

17 

140,461 

8.7 

60  -  69% 

11 

125,310 

4.1 

Table  10  provides  the  concentration  of  Hispanics  and  telephone 
clusters  in  the  5th  and  6th  Rctg  Bde  combined.  It  can  be  seen  from 
Table  8  that  the  majority  of  Mexican- Americans  reside  in  the  5th  and 
6th  Rctg  Bdes .  The  amount  of  oversampling  required  for  Mexican- 
Americans  is  about  120.  When  compared  to  the  size  of  the  sample  (400) 
expected  from  the  main  PMS  sample,  an  optimum  value  for  P-^  for 
Mexican-Americans  is  about  25%.  Considering  the  fact  that  about  80% 
of  Hispanics  in  the  5th  and  6th  Rctg  Bdes  are  Mexican-Americans,  as 
shown  in  Table  8,  about  32%  of  the  Hispanic  population  in  the  5th  and 
6th  Rctg  Bdes  should  be  oversampled.  If  all  telephone  clusters  for 
which  concentration  of  Hispanics  is  more  than  50%  in  the  frame  for 
supplementing  Hispanics  are  included,  then  32%  of  Hispanics  in  the  5th 
and  6th  Rctg  Bdes  will  be  covered.  This  frame  should  provide  the 
additional  Mexican-Americans  required  to  meet  the  desired  sample 
sizes.  The  1st,  5th  and  6th  Rctg  Bdes  combined,  will  also  provide  the 
additional  number  of  "other  Hispanics"  required  to  meet  the  precision 
levels  for  Hispanics. 
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Table  10 
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Concentration  of  Hispanics  in  Telephone  Households  in  5th  and  6th 
Recruiting  Brigades  Combined 


Hispanic 

concentration 

Number  of 
telephone  clusters 

Hispanic 

population 

Cumulative  % 
of  Hispanics 

Less  than  10% 

8,214 

1,805,040 

100.0 

10  -  19% 

1,659 

2,138,471 

84.0 

20  -  29% 

682 

1,251,331 

65.1 

30  -  39% 

437 

1,186,566 

51.7 

40  -  49% 

268 

1,063,463 

41.2 

50  -  59% 

158 

793,525 

31.8 

60  -  69% 

135 

726,472 

24.8 

70  -  79% 

106 

741,117 

18.4 

80  -  89% 

84 

836,429 

11.8 

90%+ 

52 

500,409 

4.4 

To  compensate  for  the  increase  in  variance ,  some  increases  are 
necessary  to  produce  supplements  so  that  Hispanic  samples  have  preci¬ 
sion  levels  close  to  the  desired  levels: 


Sample  sizes 
expected  from 
70,000  screened 
households 


Required 
sample  sizes 
(with  uniform 
sampling 


Required 
samples  sizes 
(with  oversampling 
concentrated  areas) 


Mexican- American 

400 

520 

Puerto  Rican 

95 

216 

Other 

175 

224 

580 

345 

250 


670 


960 


1,175 


It  should  be  noted  that  even  with  240  Puerto  Ricans  in  the 
supplement,  the  precision  of  the  total  Puerto  Rican  sample  will  proba¬ 
bly  be  less  than  the  desired  level.  Puerto  Ricans  are  about  14%  of 
all  Hispanics  in  the  U.S.  Because  Hispanics  are  about  6.5%  of  the 
total  population  in  the  U.S.,  Puerto  Ricans  are  about  0.9%  of  the 
total  U.S.  population.  Furthermore,  as  shown  earlier,  Puerto  Ricans 
are  not  heavily  concentrated  in  any  area  in  the  U.S.;  thus,  it  is  very 
costly  to  supplement  this  group  in  the  sample.  To  obtain  467 
Hispanics  of  whom  240  are  Puerto  Ricans,  using  the  concentrated  areas 
in  the  1st,  5th,  and  6th  Rctg  Bdes,  we  need  to  screen  9,550  house¬ 
holds.  A  supplemental  screening  sample  of  6,600  distributed  among  the 
1st,  5th,  and  6th  Rctg  Bdes  in  such  a  way  that  it  provides  180 
Mexican-Americans ,  145  Puerto  Ricans,  and  75  other  Hispanics  will  be 
collected.  If  the  Army  requires  sample  precision  close  to  the  desired 
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precision  levels  for  Puerto  Ricans,  the  screening  workload  will  be 
increased  so  that  the  yearly  supplemental  screening  sample  totals 
9,550. 

Longitudinal  Sample 

All  of  the  sample  of  16-  to  20-year-old  youths  will  be  randomly 
selected  for  a  longitudinal  sample  which  will  be  interviewed  in  four 
annual  followups.  When  a  survey  is  repeated  at  regular  intervals,  the 
results  are  usually  viewed  as  a  time  series  with  period- to-period 
changes  used  as  important  tools  of  analysis.  Such  changes  are  partic¬ 
ularly  important  for  examining  the  impact  of  changes  in  attitudes 
which  may  be  caused  by  advertising. 

Cluster  Size  and  Number  of  Households  to  be  Screened 

Any  cluster  size  will  produce  an  unbiased,  equal-probability 
sample.  Larger  cluster  sizes  are  somewhat  cheaper  to  execute  than 
small  ones,  but  they  risk  the  possibility  of  increase  in  the  sampling 
errors  unless  there  are  reasonably  accurate  estimates  of  the  magnitude 
of  the  intraclass  correlation  within  clusters.  An  average  about  four 
interviewed  PMS  per  cluster  is  expected  during  the  first  year  of 
ACOMS.  As  data  accumulate  during  the  year,  estimates  of  the  intra¬ 
class  correlations  for  a  number  of  key  items  will  be  prepared,  and,  if 
necessary  (i.e.,  if  these  correlations  are  too  large),  changes  in  this 
number  will  be  recommended  to  come  closer  to  an  optimum  sample  design. 

On  the  average,  about  six  households  must  be  screened  to  locate 
one  eligible  PMS.  Thus,  at  a  minimum,  in  order  to  obtain  4  PMS  per 
cluster,  about  24  households  per  cluster  will  be  needed.  This  number 
will  be  increased  to  30  to  take  into  account  the  nonresponse  rate  of 
20%.  In  order  to  obtain  the  PMS  sample  size  of  9,600,  a  total  of 
70,000  households  will  need  to  be  screened.  The  PMS  sample  sizes  can 
be  summarized  as  follows : 


Total  screening  sample 
PMS  sample 
PMS  respondents 
Number  of  clusters 


Total 

70,000 

12,000 

9,600 

2,400 


Per 

Cluster 


As  noted,  the  screening  sample  includes  an  allowance  for  a  20% 
nonresponse  rate,  as  well  as  a  few  assumptions  about  changes  in  the 
population  since  1980,  1986  telephone  households,  educational  eligi¬ 
bility,  and  nonprior  service  status  in  1986.  (These  assumptions  are 
stated  in  detail  in  Tables  5,  6,  and  7.)  The  screening  sample  is  also 
based  on  the  assumption  that  response  rate  is  uniform  across  recruit¬ 
ing  brigades,  sex,  age,  race,  and  ethnicity.  Some  minor  changes  in 
the  screening  sample  may  be  necessary  as  experience  accumulates  during 
the  first  few  months  of  data  collection.  No  additional  screening  will 


be  necessary  for  the  FS  sample  or  Black  supplement,  as  the  PMS  screen¬ 
ing  sample  will  be  large  enough  to  provide  the  required  numbers . 


Sample  Selection  Rates 


The  objectives  of  the  study  require  careful  control  of  the  sample 
sizes  for  a  wide  variety  of  population  subgroups,  such  a  PMS  and  FS , 
Blacks,  and  several  subsets  of  Hispanics.  The  subsampling  rates  for 
designating  the  persons  to  be  interviewed  in  the  screened  households 
are  calculated  to  provide  the  required  numbers.  The  following  rates 
will  be  applied  initially  to  the  sample  components: 

(1)  All  PMS  and  SMS  eligibles  will  be  interviewed,  including 
Black  and  Hispanic  males . 

(2)  The  FS  group  will  be  subsampled  at  the  rate  of  1/5. 

(3)  Parents  of  PMS  and  PFS  (16-  to  20-years  old)  will  all  be 
interviewed.  Half  of  those  sampled  will  be  mothers  of  PMS 
or  PFS,  and  half  will  be  fathers. 

The  subsampling  rates  are  based  on  a  number  of  factors: 

(a)  latest  census  information  on  population  distribution  and  extrapo¬ 
lations  of  these  data  to  1986;  (b)  data  on  the  percentage  of  youths 
with  prior  service,  by  age;  (c)  estimates  of  response  rates;  and 
(d)  assumptions  on  how  these  factors  interact,  e.g.,  that  the  response 
rate  is  the  same  in  all  recruiting  brigades  and  for  all  ages.  The 
data  and  assumptions  will,  of  course,  not  be  exact,  and  some  modifica¬ 
tion  in  the  subsampling  rates  may  be  necessary  to  bring  the  annual 
sample  sizes  in  the  various  subgroups  close  to  the  desired  levels. 

Our  control  system  will  keep  up-to-date  counts  of  the  sample  sizes  in 
each  subgroup  so  that  changes  in  the  rates  can  be  introduced  as  soon 
as  it  becomes  clear  that  this  is  necessary  for  some  subgroups. 

The  revisions  in  subsampling  rates  will  be  made  in  such  a  way 
that  unbiased  estimates  of  the  population  parameters  will  always  be 
possible  and  that  the  probabilities  of  selection  will  be  known  and 
recorded.  Periodic  summaries  of  progress  to  date  will  be  utilized. 
After  the  first  few  months  of  data  collection,  when  the  operation  has 
been  stabilized,  the  summaries  will  be  reviewed  and  sampling  rates 
changed  where  necessary.  This  review,  and  fine-tuning  of  the  sampling 
rates,  will  be  repeated  through  the  course  of  data  collection.  As  a 
result,  there  will  probably  be  a  small  amount  of  variation  in  the 
sample  sizes  from  month  to  month.  This  variation  will  not  introduce 
any  biases  in  the  monthly  or  annual  data  and  will  have  only  a  trivial 
effect  on  the  variance  of  the  quarterly  data. 

Allocation  of  the  Sample  to  Brigades 


The  sample  will  be  spread  proportionally  among  the  five  recruit 
ing  brigades.  For  the  production  of  national  estimates,  the  best 
sample  allocation  is  the  proportional  allocation  in  which  a  uniform 
sampling  rate  is  used  in  all  the  brigades.  With  the  proportional 
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allocation,  the  PMS  sample  is  expected  to  have  is  distribution  by 
recruiting  brigade: 


Brigade 

Region 


Total 


Number  of 
interviewed  PMS 

2,358 

1,667 

2,387 

1,546 

1,645 

9,603 


Allocation  of  the  Annual  Sample  to  Months 

The  annual  sample  will  be  equally  divided  across  12  months . 

Among  the  properties  of  having  equal  sample  sizes  by  month  are: 

(1)  It  is  the  best  method  of  sample  allocation  for  the  analysis 
of  annual  data,  since  in  most  cases  it  provides  the  smallest 
samp 1 i  n  g  errors; 

(2)  It  minimizes  the  sampling  errors  of  month- to -month; 

(3)  It  minimizes  the  sampling  errors  of  data  through  seasonal 
changes ; 

(4)  It  assures  adequate  sample  sizes  by  month  in  case  it  is 
necessary  to  examine  or  analyze  the  data  for  short  periods 
of  time.  The  PMS  monthly  samples  are  large  enough  to  permit 
short-term  data  analysis.  However,  we  are  not  certain 
whether  special  subgroups  such  as  Blacks  and  SMS  will  have 
adequate  monthly  sample  sizes  for  analysis  of  data  for  short 
periods  of  time;  and 

(5)  It  provides  the  smoothest  data  collection  operation. 

Response  is  expected  to  be  fairly  uniform  across  age,  race,  and 
ethnicity  for  different  geographic  regions.  So  there  is  some  uncer¬ 
tainty  in  how  close  the  actual  monthly  samples  come  to  the  desired 
monthly  sample  sizes,  using  the  initial  rates.  If  the  results  of  the 
first  few  months  indicate  that  changes  in  the  screening  levels  are 
necessary  to  generate  the  required  sample  sizes,  revision  in  the 
screening  sample  will  be  made  in  subsequent  months. 

Method  of  Calculating  Response  Rate 


Nonresponse  will  occur  during  three  stages  of  the  survey  opera¬ 
tions.  The  first  stage  is  at  screening.  Some  of  the  households 
selected  for  screening  will  not  be  available  during  the  interviewing 
period,  and  others  will  refuse  to  provide  the  requested  information. 


The  second  stage  will  be  the  detailed  interviews.  Some  of  the  sample 
youths  will  not  respond.  The  third  stage  is  interviews  with  influ¬ 
ences  . 

Screening  response  rates.  Several  methods  can  be  used  to  calcu¬ 
late  response  rates  for  RDD  surveys.  Some  notations  are  useful  to 
describe  them: 

C  -  number  of  completed  screenings 

E  -  number  of  households  contacted 

U  -  number  of  sample  telephone  numbers  whose  outcome  status  is 
unresolved  (ring-no-answer  at  all  attempts,  busy  signal, 
etc . ) 

I  -  number  of  sample  telephone  numbers  determined  to  be  nonhouse¬ 
hold  (unassigned  numbers,  businesses,  institutions,  etc.). 

Three  plausible  measures  of  response  are: 


(1)  rl  - 


(2)  R, 


(3)  Rc 


E  +  U 


E  +  pU 


where  p  - 


E  +  I 


These  three  estimates  of  response  rate  differ  in  their  treatment 
of  unresolved  cases.  The  first  (Ry)  is  a  lower  bound  of  the  response 
rates.  It  is  conservative  in  assuming  that  all  unresolved  cases  are 
households.  Ry  can  be  considered  an  upper  bound.  It  assumes  that 
none  of  the  unresolved  cases  are  households.  Ry  assumes  that  the 
household  rate  is  the  same  for  resolved  and  unresolved  cases.  The  use 
of  Rc  has  been  recommended  by  a  panel  appointed  by  the  Council  of 
American  Survey  Research  Organizations  (CASRO) . 

Ry  is  used  in  describing  the  response  rates  in  ACOMS.  In 
practice,  there  is  not  a  great  difference  among  the  methods.  As  a 
result  of  an  intensive  followup  policy,  including  checks  with  tele¬ 
phone  business  offices,  a  very  small  number  of  unresolved  cases  occur; 
1%  to  3%  is  common.  As  a  result,  the  three  response  rates  are  usually 
in  a  range  of  1%  or  2%  apart. 

Separate  response  rates  for  each  recruiting  brigade,  by  month 
will  be  produced.  It  is  not  possible  to  have  any  demographic  break¬ 
downs  (e.g.,  race  or  ethnicity),  since  such  information  will  not  be 
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available  for  nonrespondents.  More  detailed  geographic  subdivisions 
are  possible. 

Interview  response  rates.  The  calculation  of  the  response  rates 
for  the  interviews  is  quite  direct.  After  the  screening  has  been 
completed,  and  a  sample  of  youths  has  been  selected  for  detailed 
interview,  the  control  system  will  record  those  for  whom  question¬ 
naires  were  completed.  The  response  rates  are  then  the  proportion  of 
cases  with  complete  questionnaires . 

Response  rates  by  sex,  age,  race,  and  ethnicity  will  be  prepared 
routinely.  The  recordkeeping  system  will  permit  calculation  of  more 
detailed  breakdowns  of  response  rates  (by  brigades,  for  example). 

The  influencer  response  rate  will  be  calculated  in  the  same  way 
as  for  detailed  interviews.  The  subsample  of  youths  who  are  asked  to 
supply  names  of  influencers  will  be  recorded,  and  the  response  rate  is 
the  proportion  of  influencers  who  can  be  contacted  and  who  supply  the 
requested  information.  Similar  to  the  detailed  interview,  response 
rates  will  be  produced  by  sex  and  race. 

Overall  response  rate .  The  overall  response  rate  should  reflect 
both  screening  and  interview  response.  Given  the  following  notation: 

Rg  -  Screening  response  rate 

Ry  -  Youth  interview  response  rate 

Rj  -  Influencer  response  rate 

The  response  rate  for  the  youth  interviews  will  be  measured  by 

®y,o  ”  Rs  x  «y 

The  overall  response  rate  for  the  influencer  sample  will  be 

RI,0  "  Rs  x  Ry  x  Rj. 

Sample  Selection  Procedures 
Sample  of  Telephone  Clusters 

Main  sample.  Clusters  that  average  about  4  sample  PMS,  implying 
2,400  clusters  to  achieve  a  sample  of  9,600  PMS  cases  will  be  used. 
Since  only  about  20-25%  of  initial  telephone  numbers  called  (referred 
to  as  prime  numbers)  are  residential  numbers  that  will  be  retained  in 
the  cluster  sample,  we  will  start  off  with  a  sample  of  clusters  -  5  x 
2400  or  12,000.  This  number  will  be  increased  by  50%  to  have  a 
reserve  cluster  sample.  The  initially  selected  cluster  sample  will 
thus  include  18,000  clusters. 

Hispanic  supplement.  Specific  sample  sizes  are  required  for 
Mexican-Americans ,  Puerto  Ricans,  and  other  Hispanics.  The  northeast 
recruiting  brigade  (1st  Rctg  Bde)  should  provide  us  with  enough  Puerto 
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Ricans,  and  the  southwest  and  western  recruiting  brigades  (5th  and  6th 
Rctg  Bdes)  should  provide  Mexican-Americans .  These  three  recruiting 
brigades  will  also  provide  enough  Hispanics  with  other  derivations. 
Different  numbers  of  clusters  will  be  taken  from  1st  Rctg  Bde  and  the 
combination  of  the  5th  and  6th  Rctg  Bde  to  provide  the  required  number 
of  Hispanic  youth  by  derivation. 

As  previously  noted,  the  frame  for  supplementing  Hispanics  con¬ 
sists  of  all  telephone  clusters  in  the  1st  Rctg  Bde  for  which  the 
Hispanic  concentration  is  more  than  10%,  and  all  clusters  in  the  5th 
and  6th  Rctg  Bdes  for  which  concentration  of  Hispanics  is  more  than 
50%. 

A  sample  of  120  clusters  will  be  selected  from  the  1st  Rctg  Bde. 
The  clusters  will  be  divided  so  that  30  clusters  are  assigned  equally 
to  the  first  three  months  (first  quarter)  and  the  rest  distributed 
equally  to  the  rest  of  the  months  in  the  first  year.  The  clusters  for 
the  third  quarter  will  not  be  selected  until  a  decision  is  made  on  the 
number  of  clusters  to  be  drawn  from  the  1st  Rctg  Bde.  (The  maximum 
number  of  clusters  is  equal  to  200;  however,  it  may  be  decided  to 
sample  120  clusters  from  the  1st  Rctg  Bde  due  to  budget  constraints.) 

A  sample  of  612  will  be  collected  to  account,  as  much  as  possible,  for 
rejected  clusters.  The  frame  includes  617  clusters.  The  remainder  of 
the  clusters  in  the  frame  will  be  used  as  reserve. 

A  sample  of  72  clusters  will  be  selected  from  the  5th  and  6th 
Rctg  Bdes.  The  72  desired  clusters  need  to  be  increased  by  a  factor 
of  5  to  take  care  of  rejected  nonresidential  clusters.  This  implies  a 
sample  of  360  clusters.  The  remainder  of  the  frame  will  be  used  as 
the  reserve  group. 

Procedures  for  Selection  of  Primes 

The  following  procedures  are  used  for  selection  of  clusters  for 
the  main  sample.  File  sorting  and  systematic  sampling  will  achieve 
the  maximum  geographic  stratification  possible  without  extraordinary 
effort. 


(1)  All  the  usable  exchanges  in  the  U.S.  are  sorted  by  recruit¬ 
ing  brigade,  state,  and  numerical  order.  Entire  states  are 
assigned  to  recruiting  brigades  to  avoid  the  complications 
of  split  assignments,  which  would  require  geographic  coding 
of  exchanges.  States  that  cross  regions  are  put  into  the 
region  in  which  most  of  the  state's  population  resides. 

(2)  The  number  of  exchanges  in  the  U.S.  is  counted. 

(3)  A  skip  interval  is  calculated.  The  skip  interval  is  based 
on  the  number  of  primes  desired  without  the  reserves,  i.e., 
12,000  clusters.  It  is  referred  to  as  S. 
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(4)  Two  random  starts  are  generated.  One  is  a  random  number 
less  than  S,  referred  to  as  R.  The  other  will  be  R  +  . 5S . 
The  first  is  used  for  the  basic  sample  and  the  second  for 
the  reserve. 

(5)  A  systematic  sample  is  selected.  For  the  basic  sample,  the 
random  start  is  R  and  skip  interval  S.  For  the  reserve,  the 
random  start  is  R  +  .5S  and  the  skip  interval  2S. 

(6)  There  are  two  groups  of  selected  clusters:  the  main  sample 
and  the  reserve. 

(7)  The  reserve  sample  is  set  aside  and  not  used  unless  specific 
instructions  on  its  use  are  provided.  For  the  present  time, 
the  main  sample  is  of  primary  concern. 

(8)  During  the  selection  process,  the  sample  clusters  in  the 
main  sample  are  numbered  in  order  of  selection,  module  12 
(i.e.,  1,  2,  3,  .  .  .  12,  1,  2,  3,  .  .  .  12,  1,  2,  3.). 
Sample  exchanges  are  grouped  by  order  number.  Each  group  is 
then  assigned  at  random  to  one  month  of  the  year. 

(9)  The  sample  clusters  for  each  month  are  randomized 
separately. 

(10)  For  each  month,  the  usual  Westat  procedure  for  identifying 
residential  clusters  will  be  carried  out.  The  first  step  is 
to  assign  a  separate,  random,  two-digit  number  to  each 
selected  cluster.  These  are  the  prime  numbers.  The  prime 

,  numbers  for  the  first  month  are  called  to  check  which  ones 

are  residential,  proceeding  sequentially  in  the  randomized 
order.  The  process  is  stopped  when  we  have  200  clusters. 

The  unchecked  primes  are  retained  in  a  reserve  file.  (The 
1,000  clusters  per  month  are  expected  to  be  large  enough  to 
supply  the  required  number  of  residential  clusters.  If 
there  is  a  shortage  in  the  number  of  clusters,  it  will  be 
necessary  to  randomize  the  reserve  set  and  continue  checking 
for  residential  primes.) 

(11)  Telephoning  for  residential  primes  for  each  month's  inter¬ 
view  sample  will  start  about  a  month  before  the  month  of 
interview. 

The  same  procedures  for  selection  of  primes  will  be  used  for  the 
Donnelley  supplement  of  Hispanics.  The  Donnelley  selected  clusters 
will  then  be  added  to  each  month's  clusters. 

Updates  of  Primes  After  Six  Months 

A  new  tape  of  telephone  exchanges  will  be  obtained  from  AT&T 
after  the  first  six  months  of  data  collection.  The  new  tape  will  be 
matched  against  the  one  used  for  sample  selection.  There  will  be 
three  groups:  (a)  new  exchanges  on  the  current  tape,  (b)  discarded 
exchanges  on  the  tape  originally  used  for  sample  selection,  and 
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(c)  matched  exchanges.  Nothing  needs  to  be  done  with  the  matched  or 
the  discarded  group.  The  new  exchanges  will  be  sorted  in  the  same  way 
the  original  tape  was  sorted,  and  a  sample  of  primes  will  be  selected 
so  that  the  sampling  rate  for  the  new  exchanges  is  the  same  as  that 
used  for  the  main  PMS  sample. 

One  sixth  of  the  new  sample  clusters  will  randomly  be  assigned 
and  added  to  the  remaining  months.  The  combined  set  will  be  random¬ 
ized.  As  for  the  initial  month,  the  telephone  calling  to  the  primes 
and  identifying  residential  clusters  will  start  about  a  month  before 
the  interview  month. 

Three  special  situations  may  arise: 

(1)  There  may  only  be  a  few  new  exchanges  created  in  six  months. 
When  this  happens,  there  may  be  no  additions  to  the  origi¬ 
nally  selected  sample  for  some  months. 

(2)  Occasionally,  a  new  area  code  will  appear.  These  usually 
require  special  treatment  since,  for  a  time,  some  of  the 
exchanges  can  be  dialed  in  two  ways ;  they  can  be  reached  by 
dialing  the  new  area  code  or  the  area  in  which  they  were 
originally.  Procedures  will  have  to  be  established  for  each 
such  situation. 

(3)  The  discarded  exchanges  should  be  deleted  from  the  initial 
sample ,  but  the  deletions  will  automatically  follow  from  the 
procedures,  and  no  special  action  is  necessary.  Since  the 
primes  will  be  called  to  identify  residential  clusters, 
discarded  exchanges  will  show  up  as  nonresidential  and  fall 
out  of  the  sample.  It  would  be  possible  to  match  the  files 
and  remove  selected  sample  clusters  from  the  ones  to  be 
telephoned,  but  since  elimination  of  exchanges  is  a  fairly 
rare  event,  the  effort  and  cost  of  matching  seem  likely  to 
be  greater  than  that  of  the  occasional  additional  telephone 
call . 

Sample  of  Secondary  Numbers  Within  Residential  Clusters 

A  screening  sample  of  70,000  households  is  needed  for  the  main 
sample.  Experience  has  shown  that  about  60%  of  numbers  dialed  in 
residential  clusters  are  residential.  Consequently,  a  sample  of  about 
120,000  telephone  numbers  over  the  course  of  the  year  will  suffice. 
This  implies  a  sample  of  50  telephone  numbers  per  cluster. 

For  the  Hispanic  supplement,  a  screening  sample  of  40  telephone 
numbers  per  cluster  in  the  1st  Rctg  Bde  and  25  per  cluster  in  the  5th 
and  6th  Rctg  Bdes  is  needed.  Since  about  60%  of  numbers  dialed  in 
residential  clusters  are  residential,  a  sample  of  67  telephone  numbers 
per  cluster  for  the  1st  Rctg  Bde  and  42  numbers  per  cluster  for  the 
5th  and  6th  Rctg  Bdes  will  be  necessary. 


The  usual  procedures  will  be  followed  for  selecting  random  two- 
digit  numbers  to  be  added  to  the  eight  numbers  identifying  the  resi¬ 
dential  clusters.  The  two-digit  numbers  are  to  be  independently 
assigned  in  all  clusters. 

Monitoring  of  Sample  Yields 

The  sample  yields  for  the  AT&T  and  Donnelley  clusters  will  be 
examined  through  monthly  progress  reports  to  see  how  close  they  come 
to  the  numbers  desired.  If  necessary,  the  number  of  secondaries  per 
cluster  after  two  or  three  months'  experience  will  be  revised. 

Figures  1  through  8  provide  the  set  of  table  shells  for  monthly 
progress  reports. 

Sample  Weights 

The  sample  selected  from  each  of  the  sources,  the  main  sample  and 
Hispanic  supplement,  will  be  identified.  The  two  must  be  separated  in 
weighting.  All  selected  clusters  in  the  main  set  that  are  also 
included  in  the  Donnelley  Hispanic  frame  will  need  to  be  identified. 
These  groups  are  being  sampled  at  different  rates,  and  they  will  need 
to  be  assigned  different  weights. 

Special  Issues  in  Sample  Selection 
Multiple -Telephone  Households 

A  telephone  sample  comprises  a  sample  of  telephones,  not  house¬ 
holds  .  Households  with  more  than  one  telephone  number  will  have 
multiple  chances  of  selection  and  thus  be  overrepresented  in  the  . 
sample.  The  number  of  such  households  is  not  large,  probably  on  the 
order  of  3%  to  4%  of  all  households.  However,  a  procedure  is  needed 
to  deal  with  them.  It  can  be  noted  that  two- telephone-number  house¬ 
holds  are  almost  certainly  different  from  others.  They  generally  have 
higher  incomes .  Another  reason  for  having  two  numbers  may  be  that  a 
uicmfcar  of  the  household  is  operating  a  business  service  from  the  home. 
These  unusual  features  will  be  overrepresented  in  estimates  if  steps 
are  not  taken  to  compensate  for  the  increased  probability.  Household 
members  will  be  asked  during  the  screening  interview  if  they  have  more 
than  one  telephone  number.  If  they  have  more  than  one  number,  they 
are  subsampled  at  a  rate  of  one  half. 

Strategy  for  Selecting  Eligibles  Within  Sample  Households 


Sample  households  will  be  screened  to  determine  whether  any  resi¬ 
dents  are  eligible  for  the  survey.  Simultaneous  screening  will  be 
conducted  for  all  population  groups .  Several  household  members  may 
need  to  be  interviewed  in  households  with  more  than  one  PMS,  SMS,  and 
in  households  designated  for  selection  of  FS.  All  eligible  males  and 
females  within  the  sample  households  will  be  given  equal  probabilities 
of  selection.  Therefore,  for  example,  PMS's  in  large  households  will 
have  the  same  chance  of  selection  as  those  living  in  smaller  house¬ 
holds.  However,  the  actual  selection  of  more  than  one  PMS  in  a  house¬ 
hold  will  be  rare. 


Item 


1st  6th 

Total  Rctg  Bde  Rctg  Bde 
1  ...  6 


Total  sample  telephone  numbers 
Total  identified  households 
Completed  screener 
With  eligible  males 
Total 

With  PMS  16-  to  20-years -old 
With  selected  male  parent 
Selected  for  longitudinal 
sample 

With  selected  female  parent 
Selected  for  longitudinal 
sample 

With  PMS  21-  to  24-years-old 
With  SMS 

With  no  eligibles 
Refusals 

Other  nonrespondents 
Total  identified  households  for 
selection  of  females 
Completed  screener 
With  eligible  males 
Total 

With  PMS  16-  to  20-years -old 
With  selected  male  parent 
Selected  for  longitudinal 
sample 

With  selected  female  parent 
Selected  for  longitudinal 
sample 

With  PMS  21-to  24-years-old 
With  SMS 


Rctg  Bde 
unknown 


Figure  1.  Data  requirements  for  ACOMS  monthly  progress  reports 
initial  Random  Digit  Dialing  (RDD)  sample  household  analysis  (from 
screener). 


1st  6th 

Total  Rctg  Bde  Rctg  Bde  Rctg  Bde 
Item  1  ...  6  unknown 


With  eligible  females 

With  PFS  16-  to  20-years-old 
With  selected  male  parent 
Selected  for  longitudinal 
sample 

With  selected  female  parent 
Selected  for  longitudinal 
sample 

With  PFS  21-  to  24-years-old 
With  SFS 

With  no  eligibles 
Not  a  household 
No  contact 

Figure  1.  Data  requirements  for  ACOMS  monthly  progress  reports 
initial  Random  Digit  Dialing  (RDD)  sample  household  analysis  (from 
screener)  (continued). 


Sample  Total  Interview  No  Other  non 

breakdown  screened  completed  Refusal  contact  response 


PMS  by  type 
Total 
Hispanic 

Mexican- American 
Puerto  Rican 
Other 
Black 

Non-Hispanic  and 
Non-Black 
Four-year  college 
Two-year  college 

PMS  by  single  years 

16- years-old 

17- years-old 


PMS  by  geographic  area 
1st  Rctg  Bde 
2nd  Rctg  Bde 


Note .  Recruiting  brigade  can  be  approximate  if  exact  recruiting 
brigade  would  cause  delays.  Similar  breakdowns  may  be  useful  for 
other  geographic  areas,  e.g.,  ROTC  regions  or  specified  ADI ' s . 

For  Hispanics,  information  on  Hispanic  derivation  will  be  obtained 
from  detailed  questionnaire.  Information  on  total  screened  and 
screener  nonresponse  will  be  given  for  total  Hispanics. 


Figure  2.  Person  analysis  based  on  screener  and  detailed 
questionnaire:  sample  composition  for  youth. 
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Sample  Total  Interview  No  Other  non¬ 
breakdown  screened  completed  Refusal  contact  response 

SMS  by  race  and 
ethnicity 
Total 
Hispanic 

Mexican-American 
Puerto  Rican 
Other 
Black 

Non-Hispanic  and 
Non- Black 

FS ,  by  race  and 
ethnicity 
Total 
Hispanic 

Mexican-American 
Puerto  Rican 
Other 
Black 

Non-Hispanic  and 
Non- Black 

FS ,  by  single  years 

16- years-old 

17 - years-old 


PMS  by  geographic  area 
1st  Rctg  Bde 
2nd  Rctg  Bde 


Note .  Recruiting  brigade  can  be  approximate  if  exact  recruiting 
brigade  would  cause  delays.  Similar  breakdowns  may  be  useful  for 
other  geographic  areas,  e.g.,  ROTC  regions  or  specified  ADI's. 

For  Hispanics,  information  on  Hispanic  derivation  will  be  obtained 
from  detailed  questionnaire.  Information  on  total  screened  and 
screener  nonresponse  will  be  given  for  total  Hispanics. 


Figure  2.  Person  analysis  based  on  screener  and  detailed 
questionnaire:  sample  composition  for  youth  (continued). 
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Sample  Total  Interview  No  Other  non¬ 
breakdown  screened  completed  Refusal  contact  response 


Parent ,  by  youth 
Total 
PMS 
PFS 

by  sex 
male 
female 

by  type 
Hispanic 

Mexican- American 
Puerto  Rican 
Other 
Black 

Non-Hispanic  and 
Non-Black 

by  geographic  area 
1st  Rctg  Bde 
2nd  Rctg  Bde 


Note .  For  Hispanics,  information  on  Hispanic  derivation  will  be 
obtained  from  detailed  questionnaire.  Information  on  total  screened 
and  screener  nonresponse  will  be  given  for  total  Hispanics. 


Figure  3.  Sample  composition  for  parents. 


Number  of  cases  Total  Two-year  Four-year 

per  cluster  PMS  Hispanic  Black  college  college 


Number  screened 
Total 

1-2  in  cluster 
3-4  in  cluster 
5-6  in  cluster 
7-9  in  cluster 
10-14  in  cluster 
15-19  in  cluster 
20-24  in  cluster 
30+  in  cluster 


Number  interviewed 
Total 

1-2  in  cluster 
3-4  in  cluster 
5-6  in  cluster 
7-9  in  cluster 
10-14  in  cluster 
15-19  in  cluster 
20-24  in  cluster 
25-29  in  cluster 
30+  in  cluster 


Note .  The  number  per  cluster  should  be  interpreted  as  the  number  of 
type  described,  e.g.,  number  of  screened  Hispanics  in  clusters 
containing  1-2  screened  Hispanics,  number  of  screened  Blacks  in 
clusters  with  1-2  screened  Blacks,  number  of  interviewed  Hispanics  in 
clusters  of  1-2  interviewed  Hispanics,  etc. 


Figure  4.  Primary  Male  Sample  (PMS)  distribution  by  number  per 
cluster. 


Household 


Number 


Total  sample  telephone  numbers 
Completed  screener 

With  eligible  males 
Hispanic 

PMS  16-to  20-years-old 

With  selected  male  parent 

Selected  for  longitudinal  sample 
With  selected  female  parent 

Selected  for  longitudinal  sample 
PMS  21-  to  24-years-old 
SMS 

Non-Hispanic 
Without  eligible  males 
Nonresponse  households 
Refusals 

Other  respondents 
Not  a  household 
No  contact 


Figure  5.  Supplemental  Random  Digit  Dialing  (RDD)  sample  for 
Hispanics  household  analysis  from  screener  for  Donnelley  Hispanic 
supplement . 
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Tables  11  and  12  show  the  distribution  of  the  number  of  PMS  and 
PFS  per  household  in  the  universe  of  all  households  with  at  least  one 
PMS  or  one  PFS,  and  the  estimated  distribution  in  the  ACOMS  sample. 

The  estimates  take  into  account  the  fact  that  PFS  will  be  sampled  at  a 
lower  rate  than  PMS.  It  should  be  noted  that  the  SMS  and  SFS  samples 
are  not  included  in  the  tabulations.  Since  the  sample  sizes  for  SMS 
and  SFS  are  small,  when  compared  to  PMS  and  PFS,  the  distribution  of 
multiple  interviews  per  household  (for  the  total  sample  including  SMS 
and  SFS)  will  be  similar  to  the  one  provided  for  PMS  and  PFS  16-  to 
24-years  of  age. 

Table  11  presents  the  distribution  for  16-  to  20-year-old  PMS  and 
PFS.  An  interview  will  be  conducted  with  a  parent  for  households  with 
at  least  one  PMS  or  one  PFS  16-  to  20-year-old.  The  information  given 
in  Table  11  can  be  summarized  in  this  table: 


Total  number  of 
interviews  for  PMS 
and  PFS,  16-  to  20 -years  old 


Estimated  %  of 
households  in 
the  sample 

88.03 

10.97 

.85 

.11 

.00 

.03 


If  all  parents  selected  for  interviews  live  in  the  same  household 
as  the  youth,  then  the  total  number  of  interviews  per  household  will 
be  equal  to  the  number  given  in  the  above  table  plus  one.  Note  that 
the  probability  chat  all  selected  parents  will  be  in  the  same  house¬ 
hold  as  the  youth  is  small.  However,  it  is  expected  that  the  majority 
will  be  in  the  same  household. 

Table  12  provides  the  distribution  for  16-  to  24-year-old  PMS  and 
PFS.  A  summary  of  the  information  in  Table  12,  based  on  the  number  of 
interviews  for  PMS  and  PFS,  is  given  in  this  tabulation: 


Total  number  of 
interviews  for  PMS 
and  PFS,  16-  to  24-years  old 


Estimated  %  of 
households  in 
the  sample 

81.58 

15.62 

2.28 

.44 

.06 

.03 


" 


Table  11 

Telephone  Households  with  Primary  Male  Sample  (PMS)  and  Primary 
Female  Sample  (PFS)  (ages  16  to  20  years  old),  March  1985 


Type  of  household 

Number  Number 

of  of 

males  females 

Number  of 
households 
(in  thousands) 

a%  of  house¬ 
holds  in  the 
universe 

Estimated  %  of 
households  in 
the  sample 

0 

1 

4 , 164 . 92 

43.12 

13.95 

0 

2 

412.52 

4.27 

1.38 

0 

3 

33.04 

0.34 

0.11 

0 

4 

0.00 

0.00 

0.00 

0 

5 

0.00 

0.00 

0.00 

1 

0 

3.758.92 

38.91 

74.08 

1 

1 

775.33 

8.03 

2.60 

1 

2 

54.10 

0.56 

0.18 

1 

3 

1.79 

0.02 

0.01 

1 

4 

0.00 

0.00 

0.00 

1 

5 

0.00 

0.00 

0.00 

2 

0 

378.43 

3.92 

6.99 

2 

1 

45.00 

0.47 

0.15 

2 

2 

4.10 

0.04 

0.01 

2 

3 

0.00 

0.00 

0.00 

2 

4 

0.00 

0.00 

0.00 

2 

5 

0.00 

0.00 

0.00 

3 

0 

21.81 

0.23 

0.41 

3 

1 

3.20 

0.03 

0.01 

4 

0 

4.67 

0.05 

0.08 

4 

1 

0.00 

0.00 

0.00 

5 

0 

0.00 

0.00 

0.00 

5 

1 

0.00 

0.00 

0.00 

6 

0 

1.83 

0.02 

0.03 

Note.  SDecial  tabulation  from  Current 

Population  Survey 

aThe  universe  consists  of  telephone  households  with  at 

least 

one  PMS 

or  one  PFS 

Table  1 


The  entries  of  the  tables  assume  that  all  eligibles  selected  for 
interview  will  respond.  The  relationship  between  the  number  of  inter¬ 
views  per  household  and  the  response  rate  will  be  studied  when  suffi¬ 
cient  data  is  available  for  nonresponse  analysis. 

Relation  of  Timing  of  Data  Collection  to  Periods  of  Time  Analyzed 

The  period  of  time  designated  for  data  collection  (interviewing) 
for  one  month's  sample  is  six  weeks.  However,  data  collected  during 
the  calendar  month  will  be  used  as  the  unit  of  analysis.  For  example, 
the  tabulations  for  February  would  include  that  part  of  the  February 
sample  completed  in  February,  together  with  the  part  of  the  January 
sample  that  carried  over  into  the  first  two  weeks  of  February.  Carry¬ 
overs  of  the  sample  to  succeeding  months  do  not  have  similar  popula¬ 
tion  distributions  in  each  month.  However,  this  method  was  selected 
due  to  the  limited  amount  of  time  available  for  the  production  of 
periodic  reports. 

Using  data  collected  during  a  calendar  month  as  the  unit  of  anal¬ 
ysis  has  two  useful  features.  First,  in  case  it  is  necessary  to  exam¬ 
ine  or  analyze  the  data  for  one  month,  data  can  be  presented  to  the 
sponsor  within  a  short  period  of  time  after  the  reference  month.  If 
the  results  will  influence  such  decisions  as  the  desirability  of 
continuing  (or  stopping)  various  advertising  campaigns,  the  availabil¬ 
ity  of  early  analyses  is  important.  Secondly,  if  some  items  on  the 
questionnaire  are  specifically  time -dependent  (e.g.,  did  the  respon¬ 
dent  see  a  particular  TV  commercial) ,  then  the  quality  of  reporting  is 
likely  to  be  improved  if  the  date  of  interview  is  close  to  the  event. 

A  similar  advantage  will  apply  to  the  ability  to  observe  whether 
particular  national  events  affect  responses  (e.g.,  a  presidential 
speech,  a  foreign  policy  crisis,  etc.).  A  compact  interview  period 
may  better  reflect  such  events. 

The  disadvantage  of  the  calendar  month  is  its  effect  on  the 
purity  of  the  sample.  The  assumption  that  the  carryovers  of  the 
sample  to  succeeding  months  have  approximately  the  same  population 
distribution  in  each  month  is  very  doubtful..  There  will  be  many 
reasons  why  the  carryovers  in  the  beginning  of  a  month  will  be  differ¬ 
ent  from  those  not  completed  at  the  end  of  the  month.  The  number  of 
days  in  the  month,  seasonal  factors,  and  the  presence  of  holidays  such 
as  Christmas  or  Thanksgiving  are  obvious  factors.  Other  causes  could 
be  snowstorms  that  prevent  telephone  operators  from  coming  to  work,  or 
other  erratic  situations.  The  use  of  a  month's  interviews  thus  has 
the  potential  of  introducing  a  source  of  error  which  is,  at  present, 
unmeasurable . 

Weighting  the  Sample  Data 

The  sample  design  of  the  ACOMS  study  will  not  produce  a  self- 
weighting  sample  of  individuals  who  are  members  of  the  target  popula¬ 
tion.  Weighting,  with  different  weights  for  various  subdomains  of  the 
population  that  have  been  sampled  at  different  rates,  is  necessary  for 
the  production  of  unbiased  estimates.  (In  addition,  a  second  set  of 
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weights  will  be  calculated  for  the  rotating  modules  used  to  measure 
perceptions  of  attributes.)  The  sample  weights  will  be  used  with 
ACOMS  data  to  provide  estimates  of  statistics  (means,  proportions, 
etc.)  that  would  have  been  obtained  if  the  entire  sampling  frame  had 
been  surveyed.  The  weighting  system  can  be  implemented  by  assigning  a 
weight  to  each  person  in  the  sample,  inserting  the  weight  in  the 
computer  record  for  that  person,  and  then  cumulating  weights  in  the 
tabulations.  Weighting  will  be  done  to  accomplish  the  following 
obj  ectives : 

(1)  To  bring  sample  data  up  to  the  dimensions  of  population 
totals ; 

(2)  To  adjust  for  differential  probabilities  of  selection  among 
subgroups  (Hispanics ,  females)  of  the  population; 

(3)  To  minimize  biases  arising  from  the  fact  that  nonrespondents 
may  be  different  from  those  who  cooperate; 

(4)  To  compensate,  to  the  extent  possible,  for  inadequacies  in 
the  sample  frame  (the  sampling  frame  excludes  nontelephone 
households  and  possibly  persons  living  in  unconventional 
settings) ;  and 

(5)  To  reduce  variances  of  estimates  by  using  auxiliary  informa¬ 
tion  that  is  known  with  a  high  degree  of  accuracy  in  the 
estimation  procedure. 

Sample  weighting  will  be  accomplished  in  three  steps.  The  first 
two  steps  involve  computation  of  weights  to  compensate  for  unequal 
probabilities  of  selection  at  the  household  and  at  the  person  level. 
The  third  uses  post-stratification  (also  referred  to  as  ratio-estima¬ 
tion)  to  compute  weights  that  adjust  for  sample  nonresponse  and  for 
the  omission  of  nontelephone  households,  as  well  as  to  reduce  sampling 
errors.  The  next  three  sections  of  this  chapter  provide  descriptions 
of  these  steps.  The  weighting  methodology  for  the  rotating  percep¬ 
tions  modules  is  given  in  the  section  on  sampling  weights  for  the 
perceptions  of  attributes  and  the  other  rotating  modules. 

Samnline  Rate  Adiustments  at  the  Household  Level 


The  modified  Waksberg  method  will  be  used  to  sample  households. 
In  this  approach,  a  constant  number  of  telephone  numbers  per  cluster 
(rather  than  of  households,  as  in  the  standard  method)  is  selected. 

As  a  result,  households  will  have  different  probabilities  of  selec¬ 
tion.  The  rate  at  which  a  household  is  sampled  depends  on  the  propor 
tion  of  telephone  numbers  that  are  in  households  in  the  cluster  in 
which  the  household  is  located.  Households  in  clusters  that  are 
rather  sparsely  filled  are  probably  somewhat  different  from  those  in 
densely  filled  clusters.  They  are  more  likely  to  be  rural,  in  subur¬ 
ban  areas  that  are  just  being  developed,  in  locations  where  there  are 
many  businesses  mixed  with  residential  units,  etc.  These  types  of 


households  are  undersampled  when  this  sampling  technique  is  used,  and 
weighting  is  necessary  for  the  statistics  to  represent  them 
adequately. 


To  avoid  potential  biases,  a  weight  will  be  attached  to  each 
cluster  which  is  the  average  number  of  sample  households  per  cluster 
divided  by  the  number  found  in  the  particular  cluster.  That  is, 

W,-  -  — — ,  where 

1  n.- 


n  is  the  average  number  of  households  per  cluster,  and  n^  is  the 

actual  number  of  sample  households  in  the  ith  cluster. 

Furthermore,  households  with  two  telephone  numbers  have  twice  the 
chance  of  selection  and  will  be  overrepresented  by  a  factor  of  two  to 
one.  Thus,  they  will  be  given  a  weight  of  b  to  adjust  for  this  over¬ 
representation.  It  can  be  noted  that  two  telephone  number  households 
are  almost  certainly  different  from  others.  They  generally  have 
higher  incomes.  Another  reason  for  having  two  telephone  numbers  may 
be  that  a  member  of  the  household  is  operating  a  business  service  from 

the  home.  These  unusual  features  will  be  overrepresented  in  estimates 

if  weighting  is  not  used  at  this  step. 

Define  variable  1^  in  the  following  way: 

-  1  if  household  j  in  the  ith  cluster  has  one  telephone 
number 

-  h  if  household  j  has  more  than  one  telephone  number 
Then  the  household  level  weight  given  by 
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Sampling  Rate  Adjustments  at  the  Person  Level 


(1) 


The  ACOMS  survey  design  calls  for  sampling  various  population 
subgroups  at  different  rates.  Hispanics  will  be  oversampled,  and 
females  will  be  undersampled.  It  is  necessary  to  use  sample  weights 
to  make  unbiased  population  projections  that  adjust  for  the  various 
sampling  rates  used  for  population  subgroups.  Sample  rate  weighting 
adjustments  will  be  made  to  each  person  to  reflect  his  or  her  actual 
probability  of  selection.  This  adjustment  will  be  made  by  multiply  '.ng 
each  person's  first  stage  weight  in  the  sample  by  the  reciprocal  ot 


the  probability  of  selection  for  the  subdomain.  The  person  level 
weight  is  therefore  equal  to 


W2ijk  “  Wlij  *  "i  j k 


(2) 


where  is  the  reciprocal  of  the  probability  of  selection  for  the 

kth  individual  in  the  j th  household  in  cluster  i. 


These  adjustments  ensure  that  weighted  counts  for  females  and 
Hispanic  males  will  reflect  the  composition  of  the  population,  rather 
than  the  composition  of  the  unequally  selected  sample.  This  is  very 
important  since  unadjusted  sample  counts  and  percentages  could  be  very 
misleading  when  used  as  estimates  of  percentages  for  all  individuals. 

Poststratification 


Poststratification  will  be  used  to  reduce  sampling  errors,  to 
minimize  biases  arising  from  the  fact  that  nonrespondents  may  be 
different  from  those  who  respond  and  to  adjust  for  nontelephone  house¬ 
holds  missing  from  the  sampling  frame.  Poststratification  will  be 
accomplished  by  superimposing  weights  on  the  first  two  stages  of 
weighting  that  will  create  agreement  between  ACOMS  tabulations  and 
census  estimates  of  the  total  population  by  age,  sex,  race,  ethnicity, 
and  educational  level. 

Nonresponse  generally  can  be  expected  to  vary  by  population 
groups  and  thus  tends  to  distort  the  distribution  of  the  sample. 
Poststratification  compares  the  distribution  of  population  and  sample 
across  selected  variables  and  computes  sample  weights  to  make  sampling 
proportions  on  key  demographic  characteristics  more  closely  resemble 
known  population  proportions.  When  poststratification  is  not  applied 
to  the  data,  the  distribution  of  the  sample  may  be  very  different  from 
the  population,  and  sampling  errors  may  be  high. 

Furthermore,  RDD  does  not  include  households  without  telephones. 
It  is  clear  that  certain  types  of  households  are  underrepresented  in 
telephone  surveys,  e.g.,  Black,  low  income,  etc.  Although  poststrati¬ 
fication  may  not  completely  eliminate  biases  arising  from  incomplete 
coverage,  it  can  be  effective  in  sharply  reducing  the  effects  of  the 
biases . 


The  kind  of  subgroups  established  for  the  purpose  of  poststrati¬ 
fication  should  be  specifically  tailored  to  each  study  and  depend  upon 
the  sample  design  requirements  and  objectives  of  the  study.  The 
sampling  plan  for  ACOMS  is  intended  to  provide  nationally  projectable 
estimates  of  Army  communications  effectiveness.  The  samples  should 
provide,  at  a  minimum,  precise  estimates  for  male,  educationally  qual¬ 
ified  youth,  of  specific  age  groups  for  each  recruiting  brigade.  They 
should  also  provide  estimates  by  sex  and  racial/ethnic  groups  at  the 
national  level. 


Five 


(1) 
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variables  will  be  used  for  the  construction  of  poststrata: 
Recruiting  brigade:  5  categories 
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(2)  Sex:  2  categories 

(3)  Race/ethnicity:  3  categories 

(4)  Age:  9  categories,  and 

(5)  Education:  4  categories 

Poststratification  by  the  first  four  variables  is  necessary  to 
assure  that  sampling  proportions  on  these  key  variables  will  be  simi¬ 
lar  to  population  proportions.  The  fifth  variable  is  added  to  repre¬ 
sent  approximately  the  income  level  of  individuals  in  the  sample. 
Households  without  telephones  are  generally  in  lower  income  brackets 
than  telephone  households,  a  fact  that  has  been  confirmed  in  statisti¬ 
cal  analyses  during  other  research.  Since  the  average  income  of 
Blacks  is  lower  than  chat  of  the  White  population,  the  separate 
weighting  by  race  will  partially  adjust  for  this  factor.  However, 
even  within  race,  the  missed  population  will  generally  have  lower 
incomes.  The  ideal  procedure  is  to  include  income  as  well  as  age, 
sex,  and  race  in  the  estimation  procedure.  There  are  problems  in 
implementing  this  procedure.  The  income  data  are  usually  released  by 
the  Census  Bureau  about  a  year  after  the  period  covered,  and  income  is 
fairly  volatile,  changing  significantly  from  year-to-year.  In  addi¬ 
tion,  most  survey  data  on  income  are  not  quite  consistent  with  census 
data.  It  is  preferable  to  use  data  that  are  correlated  with  income, 
but  for  which  the  quality  of  responses  is  better  and  that  are  rela¬ 
tively  stable  over  time.  We  will  use  education  as  a  surrogate  for 
income . 

To  avoid  problems  arising  from  small  sample  sizes,  we  will  use 
raking  to  compute  weights  for  the  poststrata.  There  is  a  practical 
problem  in  calculating  poststratification  weights  when  the  number  of 
crosstabulation  cells  is  very  large.  Some  of  the  sample  sizes  may  be 
zero;  others  may  be  very  small,  even  just  one  or  two.  Raking  is  an 
iterative  procedure  that  creates  weights  in  which  the  weighted  sample 
estimates  equal  population  controls  for  the  marginal  totals  of  the 
poststrata  without  ensuring  the  quality  for  each  of  the  crosstabula¬ 
tion  cells.  That  is,  weighting  will  ensure  that  weighted  marginal 
distributions  of  recruiting  brigade,  age,  race,  sex,  and  education 
will  conform  to  those  in  the  population  with  no  attempt  to  achieve 
exact  agreement  between  sample  and  population  in  the  crosstabulation 
cells  (recruiting  brigade  by  age,  by  race,  by  sex,  and  by  education). 


The  poststratification  weights  wh]_mn0  will  be  computed  in 
accordance  with  procedures  suggested  by  Hansen,  Hurwitz,  &  Madow 
(1953),  such  that 
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where  the  sign  -  means  the  equations  simultaneously  satisfy  to  the 
closeness  desired.  The  subscripts  denote  these  designations: 

h  -  brigade; 

1  -  sex; 

m  -  race; 


-  age; 


-  educational  attainment  of  household  head;  and 


W 


hlmno 


,e  poststratification  weight  f 
igade,  lc  sex,  mc^  race,  nC 


or  the  h 


the 

Brigade,  i~“  sex,  m'""  race,  n-"  age 
tional  level  of  head  of  household. 


th 


Recruiting 
and  oth  educa- 


To  satisfy  equations  (3)  to  (7),  the  raking  algorithm  proceeds  by 
proportionately  weighting  the  cell  values  so  that  each  of  the  equa¬ 
tions  is  satisfied  in  turn.  Each  step  begins  with  the  results  of  the 
previous  step.  The  process  terminates  when  all  equations  are  simulta¬ 
neously  satisfied  to  the  degree  desired. 


The  weight  for  each  individual  in  the  sample  will  be  the  product 
of  the  poststratif ication  weight  and  computed  in  equation  2. 
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The  data  will  be  structured  in  a  way  that  will  allow  Army 
analysts  to  make  comparisons  of  ACOMS  findings  with  other  survey 
efforts,  such  as  the  Youth  Attitude  Tracking  Survey  (YATS  II).  The 
YATS  survey  focuses  on  enlistment  decision-making  and  is  a  more 
general  survey,  with  respect  to  subpopulations  of  interest,  when 
compared  Co  ACOMS.  Consequently,  the  YATS  weighting  methodology  does 
not  include  poststratification  adjustments  by  race/ethnicity  or  by 


recruiting  brigades.  Even  with  a  different  weighting  scheme,  ACOMS 
will  be  approximately  comparable  to  YATS  and  other  general  survey 
efforts.  The  differential  weighting  schemes  will  be  reflected  in  the 
sampling  errors  of  the  estimates  computed  from  the  ACOMS  and  the  YATS 
data . 

Sampling  Weights  for  the  Perceptions  of  Attributes  and  the  Other 


Rotating  Modules 

The  perception  module  includes  questions  about  perceptions  of  the 
active  Army,  ROTC,  National  Guard,  and  USAR,  perceptions  of  other 
military  services  (Air  Force,  Navy,  and  Marines),  and  other  nonmili¬ 
tary  options  open  to  respondents  belonging  to  the  relevant  age  group 
(i.e.,  attending  college  and  in  civilian  employment) .  To  keep  the 
length  of  the  youth  questionnaire  to  an  average  of  30  minutes,  subsets 
of  respondents  will  be  randomly  selected  and  assigned  to  Army  compo¬ 
nents  and  other  military  services'  questions.  The  size  of  the  subsam¬ 
ple  will  vary,  depending  on  the  characteristics  of  the  sample  and  the 
Army  components  and  other  services .  For  example,  almost  all  college 
students  will  be  assigned  to  ROTC  modules,  whereas  only  a  small  por¬ 
tion  of  college  students  will  be  assigned  to  Navy  or  Marines.  The 
other  rotating  modules  include  Media  Habits,  Slogan  Recognition, 
Knowledge,  and  Social  Influences  modules.  Media  Habits,  Slogan  Recog¬ 
nition,  and  Knowledge  modules  will  only  be  asked  from  one -half  of  the 
youth  sample,  and  the  Social  Influences  module  will  be  asked  from  the 
parental -linked  sample.  Therefore,  the  sample  requires  weighting  for 
the  production  of  unbiased  estimates  for  perception  of  attributes 
variables  and  other  rotating  modules. 

A  second  set  of  weights  will  be  computed  that  reflects  the 
sampling  rates  used  for  subsampling  respondents  for  the  rotating 
modules.  The  weights  will  be  used  in  tabulations  that  include  the 
rotating  questions.  The  weights  will  be  equal  to  the  reciprocal  of 
the  probability  of  selection  for  the  rotating  modcles  and  the  sampling 
weight  computed  in  equation  (8) . 
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4.  THE  ACOMS  QUESTIONNAIRES 
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Gregory  H.  Gaertner,  Veronica  F.  Nieva,  and  Bruce  F.  Allen 
A  Conceptual  Model  of  Advertising  Ef fectiveness 

The  main  Army  Communications  Objectives  Measurement  System  (ACOMS) 
survey  instruments  consist  of  youth  and  parental  questionnaires  that 
were  designed  using  a  modified  hierarchy  of  effects  model  (Fishbein  & 
Azjen,  1975)  model  of  the  advertising  process  (see  Figure  9). 

Implicit  in  the  model  is  the  notion  that  (a)  the  consumer  gains 
awareness  of  a  product  through  advertising  messages,  which  result  in 
(b)  beliefs  about  the  product,  in  interaction  with  the  consumer's  evalu¬ 
ation  of  his/her  need  for  the  product,  which  in  turn  affect  (c)  the 
respondent's  attitude  toward  the  product,  and  (d)  subsequent  intentions 
and  actions  toward  the  product.  The  model  therefore  suggests  the  major 
types  of  criteria  by  which  Acorns  will  assess  advertising  effectiveness: 

(1)  awareness  (or  recall)  of  Army  advertisements; 

(2)  positive  beliefs  or  perceptions  about  Army  attributes; 

(3)  positive  attitudes  toward  Army  enlistment,  intentions  to 
enlist,  and 

(4)  actual  enlistment-related  behaviors. 

The  model  also  posits  additional  processes  focused  on  social  influ¬ 
ence.  Perceived  social  norms  are  posited  as  affecting  the  youth's 
intentions  to  enlist.  Influential  people,  particularly  parents,  are 
seen  as  significant  factors  in  the  youth's  attraction  to  the  Army. 

Parental  attitudes  and  behaviors  are  affected  by  Army  advertising, 
in  a  process  that  parallels  that  of  the  youth.  The  parents,  like  the 
youth,  become  aware  of  the  Army  through  its  advertising,  which  if  effec¬ 
tive,  changes  their  beliefs  and  attitudes  towards  the  Army  in  a  more 
positive  direction.  Positive  parental  attitudes  are  then  expected  to  be 
manifested  in  parental  behaviors  intended  to  influence  the  youth's 
intention  to  enlist. 

In  the  current  context,  the  hierarchy  of  effects  model  suggests 
important  measures  for  consideration  in  measuring  the  effects  of  Army 
advertising.  Respondent  demographics  (e.g.,  region,  race  and  ethnicity, 
and  sex),  life  stage  (e.g.,  age,  employment  and  marital  status,  income 
or  income  of  household,  and  education),  and  media  habits  and  exposure, 
are  postulated  to  affect  respondent  awareness  of  the  Army  gained  through 
exposure  to  Army  advertising.  This  level  of  knowledge  is  hypothesized 
to  affect  respondent  beliefs  about  advertising  messages  such  as 
attributes  of  the  Army.  In  Fishbein  and  Azjen' s  model  as  adapted,  these 
beliefs  take  the  form  of  agreement  that  a  given  attribute  is  offered  by 
the  Army  (or  component,  other  service,  college  or  civilian  job). 

Corresponding  to  these  beliefs  are  evaluations  of  the  importance  of 
these  attributes  to  the  respondent  who  rates  them  by  varying  levels  of 
importance  reflecting  his  or  her  own  underlying  needs.  The  youth's 
attitudes  toward  enlistment  are  hypothesized  to  arise  as  the  products  of 
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beliefs  about  what  the  Army  offers  and  the  corresponding  personal  impor¬ 
tance  of  those  attributes.  Thus,  attitudes  will  be  positive  when  the 
respondent  believes  that  positively  evaluated  outcomes  relating  to  mili¬ 
tary  service  are  likely,  indifferent  when  perceived  outcomes  are  not 
seen  as  important  or  important  positive  outcomes  seen  as  only  moderately 
likely,  and  negative  when  negatively  evaluated  outcomes  are  likely. 

These  attitudes  are  hypothesized,  in  turn,  to  affect  behavioral 
intentions  including  propensity  toward  the  Army,  which  then  are  expected 
to  affect  behaviors.  It  is  important  to  note  that  these  actions  may 
include  enlistment,  but  are  also  likely  to  include  intermediate  actions 
like  seeking  information,  asking  for  advice,  seeing  a  recruiter,  and  so 
on.  As  the  model  suggests,  these  intermediate  actions  can  feed  back  on 
beliefs  and  evaluations. 

The  model  also  includes  the  effects  of  social  (especially  parental) 
influence  on  the  decision  process.  Parents  of  a  subset  of  ACOMS  respon¬ 
dents  are  to  be  interviewed  on  their  exposure  to  Army  advertising,  and 
beliefs  and  evaluations  of  Army  attributes  parallel  to  the  youth  inter¬ 
views.  The  parent  is  also  asked  his  or  her  preferences  for  the  target 
youth's  future  and  how  he  or  she  has  attempted  to  influence  the  youth's 
planning. 


Model  Applications 

As  an  example  of  the  application  of  the  model  to  actual  cases, 
consider  the  decision  process4ss  for  respondents  for  whom  getting  money 
for  college  is  of  primary  importance.  As  the  time  to  make  college - 
related  decisions  approaches,  they  will  probably  explore  how  they  can 
get  this  money.  One  message  of  U.S.  Army  Recruiting  Command  (USAREC) 
advertising  is  that  "with  ACF  (Army  College  Fund)  you  can  go  to  college 
'older,  wiser,  and  richer'."  This  message,  if  effective,  will  raise  the 
level  of  belief,  especially  among  those  interested  in  college  funding, 
that  the  Army  offers  the  opportunity  to  get  funding  for  college.  If  the 
basic  model  is  correct, this  heightened  belief  will  result  in  improved 
attitudes  toward  enlistment,  and  an  intention  to  seek  more  information 
about  service  in  the  Army  for  those  who  attach  a  positive  importance  to 
obtaining  college  funding.  This  intention  may  result  in  subsequent 
action  which  may  refine  or  confirm  their  beliefs,  leading  to  additional 
actions  and  so  on.  This  step  sequence  is  depicted  in  Figure  10,  top 
panel.  Although  not  displayed  in  the  figure,  the  youth  may  also  be 
assessing  the  experience  and  beliefs  of  his  or  her  classmates,  or  seek¬ 
ing  (or  receiving  unsought)  the  advise  of  his/her  parents,  which  may 
affect  the  search- and-decis ion  process. 

The  bottom  panel  depicts  a  more  truncated  search  process  for  a 
respondent  for  whom  patriotism  is  of  primary  importance.  To  the  extent 
that  the  respondent  receives  the  message  that  the  Army  is  "the  best  way 
to  serve  your  country,"  his/her  belief  in  the  Army  as  an  expression  of 
patriotism  is  reinforced.  This  might  lead,  rather  directly,  to  a 
recruiter  visit  and  a  subsequent  enlistment  when  enlistment  becomes  a 
practical  possibility.  Again,  parental  and  social  influences  may  have 
effects,  to  greater  or  lesser  extents. 
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The  model  implies  that  there  are  features  of  "readiness"  associated 
with  life  stage  (e.g.,  need  for  college  funding  in  the  first  example, 
and  ability  to  make  significant  life  choices  in  the  second)  which  allow 
or  impel  the  youth  to  make  decisions  for  which  information  was  already 
available.  Further,  the  two  groups  of  respondents  depicted  in  Figure  10 
are  likely  to  come  from  different  demographic  and  motivational  back¬ 
grounds,  and  advertising  is  likely  to  affect  them  very  differently. 

However  these  are  only  the  most  obvious  effects  of  advertising,  and 
only  the  most  obvious  applications  of  the  model.  An  additional  effect 
of  advertising  may  be  to  decouple  attributes  from  the  Army  for  example, 
by  dispelling  the  belief  that  one  loses  out  on  career  opportunities  by 
choosing  the  Army.  If  this  advertising  is  effective,  it  would  not  be  by 
changing  the  importance  of  career  concerns ,  but  rather  by  reducing  the 
presumed  association  between  military  service  and  career  disadvantage. 

In  fact,  this  is  one  of  USAREC's  communications  objectives.  A  further 
effect  of  advertising  might  not  be  on  levels  of  variables  in  the  model 
but  rather  on  relationships  between  variables.  An  example  might  be  to 
strengthen  the  link  between  intention  and  action  by  making  available 
better  methods  for  gaining  information  on  the  Army,  allowing  curious 
respondents  to  search  for  information  more  easily. 

The  ACOMS  Questionnaire 

ACOMS  currently  includes  three  survey  instruments:  (a)  the  house¬ 
hold  screener,  (b)  the  youth  questionnaire,  and  (c)  the  parent  question¬ 
naire.  These  questionnaires  are  presented  in  Appendix  B.  In  the 
future,  a  longitudinal  questionnaire  will  be  designed  for  youth  who  will 
be  re  interviewed  annually. 

The  Household  Screener 

The  household  screener  is  a  brief,  three -minute  instrument  designed 
to  locate  target  respondents  for  the  full  ACOMS  interview.  Using  the 
random  digit  dialing  (RDD)  method  of  sample  selection,  telephone  numbers 
are  contacted  at  random.  The  screener  interview  is  used  to  identify  and 
eliminate  nonhousehold  telephone  numbers  such  as  businesses  and  insti¬ 
tutional  telephone  numbers  as  well  as  households  that  do  not  have  youth 
who  fullfill  ACOMS  eligibility  requirements.  The  screener  interview  is 
conducted  with  any  knowledgeable  household  member. 

The  Youth  Interview 

The  youth  interviews,  which  average  about  30  minutes  in  length, 
provide  the  major  measures  of  the  dynamics  and  effects  of  Army  advertis¬ 
ing  available  in  ACOMS.  In  accordance  with  the  conceptual  model  which 
has  guided  the  development  of  ACOMS,  the  youth  interview  is  divided  into 
14  topical  modules.  In  order  to  achieve  a  30-minute  average  interview 
while  ensuring  that  all  necessary  information  is  obtained,  a  complex 
questionnaire  structure  was  developed.  The  14  questionnaire  modules  are 
divided  into  8  "core"  modules  which  are  asked  of  all  respondents,  and  6 
"rotating"  modules  which  are  asked  of  a  subset  of  respondents. 
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Figure  10.  Enlistment  decision-sequences  for  differently  motivated 
respond ents. 
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In  addition,  sections  in  one  of  the  core  modules,  Perceptions/ 
Beliefs,  are  assigned  differentially  to  a  subset  of  respondents,  primar¬ 
ily  defined  in  terms  of  their  educational  attainment  and  plans.  These 
module  rotation  strategies  are  discussed  in  further  detail  later  in  this 
discussion. 


Core  modules.  The  core  modules  are: 


(1) 


Education  and  Employment:  elicits  employment  history  and 
measures  of  course -content  and  school  performance  useful  for 
assessing  quality. 


(2) 


Intentions  and  Propensity:  asks  for  the  respondent's  plans 
for  the  next  few  years,  constructed  to  parallel  and  supplement 
measures  of  Army  propensity  in  the  Youth  Attitude  Tracking 
Study  II  (YATS  II) . 


(3) 


Behaviors:  elicits  information  on  the  respondent's  activities 

to  enlistment,  employment  and/or  college  enrollment. 


(4) 


Importance  of  Attributes:  assesses  the  importance  to  the 
respondent  of  attributes  defined  by  the  Army's  communications 
objectives.  These  items  correspond  to  the  evaluation  compo¬ 
nent  of  the  Hierarchy  of  Effects  model. 


(5) 


Knowledge  - Recall :  asks  for  unaided  and  aided  recall  of  Army 
(by  component)  and  other  service  advertising,  presented  in 
random  order.  The  respondent  is  also  asked  where  the  adver¬ 
tising  was  seen  or  heard,  what  its  main  message  was,  and 
whether  he/she  believed  and/or  liked  it. 


(6) 


Attitude  Toward  Array  Advertising:  ascertains  how  much  the 
youth  likes  and  believes  the  advertisements  he/she  has  seen  or 
heard. 


(7) 


Perceptions/Beliefs:  asks  whether  the  Army  (by  component), 

other  services,  military  service  in  general  and/or  college  and 
civilian  employment  offer  the  attributes  defined  by  the  Army's 
communications  objectives  presented  in  random  order.  These 
items  correspond  to  beliefs  in  the  Hierarchy  of  Effects  model. 


(8) 


Demographics :  elicits  information  on  respondent’s  ethnicity, 
marital  status,  Social  Security  number,  socioeconomic  back¬ 
ground,  and  current  address. 


The  noncore  modules  are: 
elicits  information  on  the  amounts  of  televi 

i  -si  fVin  i  c  r-  o  m  i  1  or! 


Rotating  modules. 

(9)  Media  Habits:  elicits  information  on  the  amounts  of  televi 
sion,  radio,  and  print  material  the  respondent  is  regularly 
exposed  to,  and  his/her  favorite  programs  and  print  vehicle 
a  randomlv  selected  half  of  all  vouth 


(asked  only  of  a  randomly  selected  half  of  all  youth 
respondents) . 
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(10)  Knowledge-Slogan  Recognition:  asks  whether  the  respondent  can 
identify  slogans  utilized  in  Army,  other  services  and  joint- 
service  advertising  presented  in  random  order  (asked  only  of  a 
randomly  selected  half  of  all  youth  respondents). 

(11)  Knowledge -Awareness :  asks  for  the  respondent's  level  of 
knowledge  concerning  Army  offers  (asked  only  of  a  randomly 
selected  half  of  all  youth  respondents) . 

(12)  Parental -Location  Information:  elicits  information  required 
to  contact  parents  (asked  only  of  parental - linked  target 
youth) . 

(13)  Social  Influences:  asks  for  the  respondent's  assessments  of 
the  attitudes  of  friends,  parents  and  others  toward  enlistment 
(asked  only  of  parental-linked  target  youths). 

(14)  Tracking  Information:  elicits  information  required  to  trace 
youth  selected  for  inclusion  in  the  longitudinal  sample, 
including  anticipated  changes  in  telephone  number,  names  and 
phone  numbers  of  employer  and  two  others  likely  to  know 
respondent's  whereabouts  (asked  only  of  longitudinal  sample). 

Thus,  certain  modules  will  only  be  asked  of  particular  groups  of 
respondents.  Tracking  and  Social  Influences  will  only  be  asked  of 
target  youths  in  the  parental-linked  sample,  since  these  respondents 
allow  the  fullest  test  of  the  social/normative  aspects  of  the  conceptual 
model.  In  addition,  Slogan  Recognition,  Knowledge -Awareness ,  and  Media 
Habits  modules  will  be  asked  of  only  a  randomly  selected  half  of  all 
youth  respondents  and  each  possible  pair  of  modules  is  asked  of  one- 
sixth  of  the  sample. 

Slogan  Recognition,  Knowledge -Awareness  and  Media  Habits  modules 
will  be  distributed  among  respondents  as  shown  in  Table  13.  Respondents 
will  be  assigned  randomly  to  each  of  the  three  modules  with  a  probabil¬ 
ity  of  .333.  Half  will  not  be  assigned  a  second  module  from  this  group 
of  three.  The  remaining  half  receive  one  of  the  two  remaining  modules 
with  equal  probability.  The  average  respondent  will  receive  1.5  modules 
of  the  three,  a  substantial  saving  of  time. 
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Module  Rotation  Plan 


Second  Module 

Media 

Habits 

Slogan 

Recognition 

Knowledge  • 
Awareness 

None 

Percentage 

Media  habits 

0.0% 

8.3% 

8.3% 

16.7% 

33.3% 

Slogan 

recognition 

8.3% 

0.0% 

8.3% 

16.7% 

33.3% 

Knowledge - 
Awareness 

8.3% 

8.3% 

0.0% 

16.7% 

33.3% 

Percentage 

16.7% 

16.7% 

16.7% 

50% 

100% 

Allocation  of  the  Perception/Beliefs  sections.  The  Perceptions/ 
Belief  module  c  institutes  the  core  of  the  ACOMS  questionnaire.  The 
module  contains  questions  about  those  attributes  which  constitute  the 
major  copy  points,  or  communications  objectives,  or  Army  advertising. 
These  communications  objectives  were  developed  in  an  iterative  process 
that  involved  group  and  individual  discussions  with  Special  Advisory 
Group  (SAG)  members  and  other  Army  representatives. 

ACOMS  respondents  are  asked  whether  these  attributes  are  descrip¬ 
tive  of  10  referents  (active  Army,  Reserve  Officers'  Training  Corps 
(ROTC) ,  Army  National  Guard  (ARNG) ,  U.S.  Army  Reserve  (USAR) ,  Navy, 
Marines,  Air  Force,  military  service  generally,  college,  and  work)  that 
may  be  perceived  by  the  youth  as  future  career  options.  Table  14  shows 
the  attributes  asked  about  each  of  the  service  and  career  referents. 
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The  attributes  list  for  each  referent  is  considered  a  "section"  in 
the  Perceptions  module.  Since  asking  any  single  individual  to  respond 
to  all  10  sections  would  be  an  intolerable  burden,  a  plan  to  allocate 
respondents  to  perceptions  sections  was  devised  in  collaboration  with 
the  SAG . 

The  allocation  scheme  was  intended  to  reflect  the  market  priorities 
of  each  of  the  Army  components.  Respondents  are  divided  into  six 
groups : 

(1)  Those  who  have  completed  three  or  more  years  of  college; 


r 


(2)  Respondents  currently  enrolled  in  first  or  second  year  of 
college ; 
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(3)  High  school  students  intending  to  go  to  college; 

(4)  High  school  students  not  intending  to  go  to  college; 

(5)  High  school  diploma  graduates  not  currently  enrolled  in 
college;  and 

(6)  High  school  noncompleters. 

The  characteristics  of  the  allocation  scheme  are  specified  below. 

(1)  All  respondents  are  asked  about  two  components,  usually  active 
Army  and  one  other.  However,  one  group  (college-bound  high 
school  students)  will  be  asked  three  modules. 

(2)  All  Primary  Male  Analytic  Sample/Primary  Female  Analytic 
Sample  (PMAS/PFAS)  eligibles  will  be  asked  the  active  Army 
perceptions  questions  (Groups  2  through  5) . 

(3)  Those  attaining  three  or  more  years  of  college  (Group  1)  will 
be  asked  two  sets  of  questions,  those  pertaining  to  ROTC  and 
one  other  component,  branch,  college,  or  civilian  job. 

(4)  College  freshmen  and  sophomores  (Group  2)  will  be  asked  two 
modules,  either  active  Army,  or  ROTC,  and  one  other.  One- 
third  of  Group  2  will  be  asked  active  Army,  and  ROTC,  one- 
third  active  Army  and  one  other  module,  and  one-third  ROTC, 
and  one  other  module. 

(5)  College -bound  high  school  students  (Group  3)  will  be  asked 
three  modules,  active  Army,  ROTC,  and  one  other. 

(6)  Noncollege -bound  high  school  students  and  high  school  gradu¬ 
ates  not  currently  enrolled  (Groups  4  and  5,  respectively) 
will  be  asked  active  Army  and  one  other  set. 

(7)  Secondary  Male  Sample/Secondary  Female  Sample  (SMS/SFS) 
respondents  will  be  allocated  as  Group  4  and  5. 

Table  15  presents  the  expected  distribution  of  PMS  respondents, 
making  some  assumptions  about  the  distribution  of  respondents  to  the 
five  groups.  If  we  assume  that  about  10%  of  all  PMS  respondents  will 
have  completed  the  third  year  of  college  or  more,  24%  are  freshmen  and 
sophomores,  11%  of  high  school  students  are  college-bound,  13%  of  high 
school  students  are  noncollege -bound,  and  that  42%  of  high  school  gradu¬ 
ates  are  not  enrolled  in  college,  we  would  expect,  for  example,  about 
970  sets  of  responses  to  the  ROTC  questions  annually  from  those  in  their 
third  year  of  college  or  more,  and  so  on.  It  should  be  emphasized  that 
these  are  expected  numbers.  Actual  distributions  will  depend  on  the 
validity  of  the  assumptions  underlying  the  distribution  to  groups,  and 
the  pertormance  of  the  random  assignment.  The  assumptions  were  based  on 
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extrapolations  from  the  Current  Population  Survey  and  the  Fall  1985 
Youth  Attitude  Tracking  Survey  II  (YATS  II). 

It  is  useful  to  explore  the  effects  of  these  sample  sizes  on  the 
statistical  power  of  the  PMAS.  In  Table  16,  we  present  the  smallest 
detectable  difference  (between  months,  quarters  or  years,  depending  on 
the  two)  in  the  estimate  of  the  proportion  of  .5  for  the  sample  sizes  as 
depicted  in  Table  15.  Table  16  illustrates  the  smallest  difference 
which  will  lead  to  a  rejection  of  the  null  hypothesis  of  no  difference 
over  time  (assuming  p-p^-p2~.5). 

As  should  be  apparent,  almost  any  substantively  meaningful  annual 
difference  will  be  statistically  significant  in  the  sample  as  a  whole, 
whether  for  active  (.017),  ROTC  (.036),  USAR  and  ARNG  (.044  or  .046),  or 
even  other  components  (.045  or  .048).  Confidence  intervals  for  quar¬ 
terly  and  even  monthly  differences  are  still  reasonably  tight  for  active 
Army  and  ROTC.  Monthly  and  quarterly  differences  within  segments ,  how¬ 
ever,  become  precarious,  especially  for  other  components.  However, 
since  quarterly  estimates  for  these  other  components  are  not  of  critical 
importance,  this  design  tradeoff  seems  appropriate. 

The  Parental  Interview 

The  parental  interview,  to  be  conducted  with  a  predesignated  parent 
of  target  youths  16-  to  20-years  of  age,  was  constructed  in  parallel 
with  the  youth  interview.  It  contains  eight  modules  in  the  following 
order : 

(1)  Parental  Influence:  probes  whether  the  parent  has  discussed 
military  service  with  the  target  youth,  his/her  expectations 
for  him/her,  and  beliefs  that  military  service  is  a  good  or 
bad  idea  for  most  young  men  and  women. 

(2)  Importance  of  Attributes:  repeats  the  items  in  the  youth 
version  which  assess  the  importance  of  attributes,  this  time 
asking  the  parent  about  the  importance  of  these  attributes  to 
the  target  youth. 

(3)  Media  Habits:  these  items  are  identical  to  those  asked  of  the 
youth  and  focus  on  the  amounts  of  television,  radio,  and  print 
material  the  parent  is  regularly  exposed  to,  and  his/her 
favorite  programs  and  print  vehicles. 

(4)  Knowledge -Recall :  these  questions  are  also  identical  to  those 
in  the  youth  questionnaire  and  ask  for  unaided  and  aided 
recall  of  Army  and  other  service  advertising  with  questions  in 
random  order. 

(5)  Attitudes  Toward  Army  Advertising:  addresses  how  much  the 

parent  likes  and  believes  the  advertisements  he/she  has  heard 
or  seen,  using  the  same  items  as  those  in  the  youth  interview.  ) 
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(6)  Perceptions:  are  probed  with  the  identical  questions  asked  of  £ 

the  target  youth  about  the  extent  to  which  the  Army  (by  compo- 

nent) ,  other  services,  military  service  in  general,  college,  ' 

js  -y:f.  >(  '• 

« 

and  civilian  employment  offer  the  attributes  defined  by  the  \ 

Army's  communications  objectives. 

V* 

(7)  Knowledge -Awareness :  these  items  assess  the  parent's  knowl-  j 

edge,  as  in  the  youth  interview,  of  Army  benefits  and 

programs .  ^ 

i 

4 

• 

5 

(8)  Demographics:  these  items  elicit  information  on  the  parent's 

ethnicity,  marital  status,  socioeconomic  background  and  jj 

military  experience . 

‘ 

y 

In  essence,  the  parental  interview  adds  one  module  to  the  youth 
questionnaire  (Parental  Influence),  and  drops  Education  and  Employment, 

Intentions/Propensity ,  Behaviors,  Social  Influences,  Slogan  Recognition,  \ 

( 

n 

■ 

and  the  Parental  Location  and  Tracking  modules  from  the  youth  interview.  5 

Except  in  the  Importance  module  in  which  the  referent  for  the  items  is 

» 

r 

r 

p* 

changed  to  the  youth,  nearly  all  question-wordings  are  identical  to  C 

those  in  the  youth  questionnaire.  Further,  where  random  assignment  to 

or  within  modules  is  performed  for  the  youth  interview,  the  parent's  A 

interview  will  be  assigned  to  the  same  modules  and  sections  at  the 

> 

i< 

i* 

target  youth.  Thus,  if  the  target  youth  was  asked  questions  on  percep- 
tions  of  Army  and  college  attributes,  the  parent  is  also  asked  the 

Perceptions  questions  for  Army  and  college  attributes.  Further,  if  the  ^ 

youth  was  asked  Media  Habits  and  Knowledge -Awareness ,  the  parent  is 

asked  the  same  modules .  v 
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5.  DATA  COLLECTION  AND  PROCESSING 
Michael  D.  Rhoads  and  Veronica  F.  Nieva 
The  Computer-Assisted  Telephone  Interview  £CATI_)  System:  An  Overview 

The  Army  Communications  Objectives  Measurement  System  (ACOMS) 
interviews  will  be  conducted  using  Westat's  proprietary  computer- 
assisted  telephone  interview  (CATI)  system.  The  system  consists  of 
state  of  the  art  software  that  facilitates  the  collection  and  process¬ 
ing  of  complex  data.  The  CATI  system  is  particularly  appropriate  for 
surveys  with  complicated  instruments,  like  ACOMS,  in  which  the  types 
of  information  collected  from  different  respondents  varies  according 
to  key  respondent  characteristics. 

The  CATI  system  automates  the  presentation/elimination  of  differ¬ 
ent  sets  of  questions  based  on  answers  obtained  earlier  in  the  inter¬ 
view.  Question-wording  choices  and  randomized  question  presentation 
are  also  automated.  This  characteristic  makes  the  interviewing  pro¬ 
cess  considerably  more  efficient  than  using  the  traditional  hard-copy 
instrument,  and  also  leads  to  significantly  fewer  interviewer  errors 
in  questionnaires  with  complicated  skip  and  branching  structures. 

The  CATI  system's  internal  editing  capabilities  also  reduce  error 
and  the  amount  of  time  required  to  process  the  survey  data.  CATI 
operations  include  internal  validity  checks  for  value  ranges,  as  well 
as  on-line  consistency  checks  across  related  survey  items.  These 
capabilities  virtually  eliminate  the  need  for  data  retrieval  and 
extensive  postinterview  data  cleaning  operations.  They  also  minimize 
postdata  collection  editing,  thus  facilitating  rapid  preparation  of 
data  files  for  analysis. 

Westat's  CATI  system  further  minimizes  the  possibility  of  erro¬ 
neous  data  by  maintaining  an  audit  trail  file  for  each  interview. 

Every  keystroke  that  an  interviewer  enters  through  the  keyboard  is 
recorded  in  this  file.  Any  questions  about  how  particular  responses 
were  recorded  during  the  conduct  of  the  interview  can  be  examined 
using  the  audit  trail  for  any  case. 


i 


•1 


Another  feature  of  the  CATI  system  is  the  automated  scheduler 
program  that  automatically  schedules  cases  based  on  study- specif ic 
algorithms.  The  scheduler  handles  both  initial  calls  and  subsequent 
"callbacks."  As  each  call  to  every  individual  number  is  attempted,  a 
result  code  (e.g.,  "ring-no  answer,"  completed,  or  specific  appoint¬ 
ments)  is  entered  into  the  system  which  triggers  action  on  that  par¬ 
ticular  case  if  other  attempts  are  necessary.  The  management  system 
maintains  a  record  of  each  call  attempt  made  to  each  assigned  number. 

Finally,  the  CATI  software  creates  both  tape  and  hard-copy  ver¬ 
sions  of  the  questionnaire,  code  book,  and  call  disposition  record. 
Thus  the  documentation,  variables,  and  data-  and  file-editing  pro¬ 


cesses  are  integrated  to 
are  necessary  when  using 
program  documentation  in 


make  it  possible  to  eliminate  many  steps  that 
other  software,  such  as  SAS .  In  summary,  the 
the  CATI  system  includes:  the  questionnaire 
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actually  used  by  interviewers;  a  code  book;  a  call  disposition  record; 
SAS  analysis  programs;  and  current,  reliable  information. 

Sample  Selection 

The  ACOMS  survey  data  will  be  collected  via  telephone  interviews 
of  a  nationally  representative  sample  of  youth  and  their  parents.  As 
discussed  in  Chapter  3,  Sample  Design  (Mohadjer  &  Waksberg,  1988),  the 
sample  will  be  selected  using  the  Waksberg  Random  Digit  Dialing  (RDD) 
method,  whereby  randomly  selected  telephone  numbers  are  screened  for 
the  youth  who  have  characteristics  of  interest  to  the  survey.  The  RDD 
method  of  sample  selection  uses  an  AT&T  listing  of  all  existing  tele¬ 
phone  area  codes  and  telephone  numbers.  Using  this  method,  we  expect 
to  locate  the  required  numbers  of  White  and  Black  youth.  However,  the 
method  will  not  yield  a  sufficient  number  of  Hispanic  youth  for  sepa¬ 
rate  analysis;  therefore,  supplementation  of  this  relatively  rare  pop¬ 
ulation  will  be  drawn  from  telephone  exchanges  in  which  very  heavy 
concentrations  of  Hispanics  are  located. 

For  both  the  main  sample  and  the  supplement,  the  approach  to 
sample  identification  will  be  identical.  For  each  telephone  number 
contacted,  a  brief  "screener  interview"  will  be  administered  in  order 
to  identify:  (a)  whether  the  number  contacted  belongs  to  a  household 
(versus  a  business  or  other  type  of  institution)  and  if  so,  (b) 
whether  target  youth  with  the  desired  characteristics  of  age,  educa¬ 
tion,  and  prior  or  current  service  status  can  be  located  at  that  tele¬ 
phone  number.  If  a  target  youth  is  identified  by  the  screener,  a  com¬ 
plete  youth  interview  is  administered.  In  households  with  multiple 
eligible  youth,  or  in  households  in  which  a  parent  has  been  designated 
for  interview,  attempts  will  be  made  to  complete  all  the  necessary 
interviews  within  the  household. 

In  many  cases,  several  telephone  calls  will  be  necessary  to  com¬ 
plete  all  the  interviews  within  a  household.  Up  to  ten  callbacks  will 
be  made,  at  different  times  of  the  day,  in  order  to  complete  inter¬ 
views  within  the  household.  When  possible,  appointments  will  be  made 
for  the  best  times  to  call  back  for  the  interviews.  Callbacks  will 
also  be  made  in  cases  where  an  initial  refusal  is  encountered,  so  that 
a  different  household  member  may  be  contacted  (in  the  case  of  a 
screener  call)  or  to  attempt  a  "refusal -conversion"  effort  for  a 
target  respondent. 

The  interview  work  flow  will  be  handled  through  the  automated 
CATI  scheduler.  The  scheduler  will  release  the  monthly  sample  of 
telephone  numbers  for  initial  contact,  as  well  as  trigger  appropriate 
followup  action  for  each  case. 

In  brief,  the  scheduler  uses  a  series  of  algorithms  that  arrange 
calls  by  time  zone,  randomize  callbacks  across  different  days  of  the 
week  and  different  times  of  day,  and  sort  cases  by  status.  Cases  can 
be  classified  as  refusals,  callbacks,  with  or  without  appointments,  or 
"ring-no  answers".  The  algorithms  are  designed  to  meet  project  speci¬ 
fications  and  priorities,  and  they  can  be  adjusted  when  needed. 
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The  interview  work  flow  will  be  controlled  on  a  monthly  basis.  A 
sample  of  telephone  numbers  will  be  drawn  once  a  month  from  the  AT&T 
and  Donnelley  lists.  For  each  "sample  draw,”  the  active  interview 
period  for  conducting  the  household  screener  interviews  and  the  target 
youth  interviews  will  be  six  weeks.  That  is,  at  the  start  of  each 
month,  a  new  sample  of  telephone  numbers  will  be  activated.  Household 
screener  interviews  will  be  conducted,  and  attempts  will  be  made  to 
interview  all  target  youth  identified  within  six  weeks  after  the  start 
of  the  month.  The  parental  sample  will  be  contacted  within  a  four- 
week  period  after  the  linked  target  youth  interview  is  completed. 

ACOMS  Interviewers 

The  ACOMS  interviews  will  be  conducted  by  a  staff  of  about  50 
interviewers  trained  to  perform  a  number  of  demanding  tasks  simultane¬ 
ously.  They  must  establish  rapport  with  a  respondent,  accurately  read 
the  question  shown  on  their  CRT  screen,  correctly  code  the  response, 
enter  messages  to  the  respondent's  file  indicating  that  a  probe  (e.g., 
rereading  the  question,  prescripted  clarification  of  the  item)  was 
required,  record  verbatim  a  respondent’s  comments  on  a  question,  and 
keep  the  respondent's  interest  long  enough  to  complete  the  interview. 

The  ACOMS  interviewers  will  complete  an  extensive  training  pro¬ 
gram  designed  to  provide  them  with  the  multiple  skills  required  by  the 
CATI  approach.  The  training  program  will  require  the  active  partici¬ 
pation  of  all  trainees  and  simulate  the  actual  conditions  of  the 
survey.  This  "hands-on"  approach  has  many  advantages  over  the 
lecture -style  presentation  which  leads  to  much  lower  retention  of  the 
training  material. 

All  telephone  interviewers  will  participate  in  Westat's  four-hour 
"General  Interviewing  Techniques"  training  program  in  which  trainees 
are  instructed  in  basic  telephone  techniques,  including  ways  to  obtain 
accurate  data  through  listening  and  probing,  and  methods  for  gaining 
respondent  cooperation.  Also  included  in  this  session  will  be  a  brief 
presentation  on  diction  and  voice  control. 

Before  the  start  of  each  survey  and  periodically  thereafter,  as 
necessary,  project-specific  training  will  be  provided  to  interviewers. 
This  training  will  consist  of  an  average  of  30  hours  devoted  to 
acquainting  the  interviewers  with  the  project  goals,  terminology,  and 
specific  instruments.  The  program  will  involve  a  variety  of  basic 
training  techniques:  home  study,  interactive  lecture  to  the  entire 

training  group,  interactive  lecture  to  small  groups  of  trainees,  dyad 
role-playing,  and  exercises.  The  training  manual  to  be  used  for  ACOMS 
interviewers  is  available  separately  (Westat,  1987). 

The  majority  of  training  time  will  be  spent  on  the  three  ACOMS 
instruments:  the  household  screener  and  the  youth  and  parental 

questionnaires.  Trainers  will  work  from  three  types  of  scripts, 

(a)  interactive  scripts,  (b)  community  scripts,  and  (c)  role-playing 
scripts.  These  scripts  are  designed  to  demonstrate  the  various  skip 
patterns,  recording  issues,  and  potential  problems  in  an  ACOMS 
interview . 


Interactive  scripts  are  the  simplest  of  the  three,  designed  to 
show  trainees  the  main  questions  in  the  interview  without  any  problem¬ 
atic  or  unusual  responses.  These  scripts  will  be  used  during  instruc¬ 
tion  on  question-by-question  specifications. 

While  working  from  the  community  scripts,  the  trainer  will  take 
the  respondent's  role  and  call  on  trainees  to  act  as  interviewers. 
These  scripts  typically  will  be  administered  in  small  groups,  hence 
the  reference  to  community.  Community  scripts  are  typically  designed 
to  demonstrate  specific  skip  patterns  and  problem  areas,  to  reinforce 
CAT I  conventions  and  project  definitions  introduced  earlier,  and  to 
give  trainees  practice  in  answering  respondents'  questions. 

Trainees  will  also  work  in  pairs  with  role-playing  scripts.  One 
member  of  the  pair  will  act  as  the  interviewer  and  the  second  member 
will  act  as  the  respondent.  Role-playing  script  booklets  will  be 
provided  in  which  all  responses  are  predetermined  for  the  "respon¬ 
dent."  Each  pair  of  trainees  will  receive  a  total  of  four  role- 
playing  scripts:  one  parental  and  three  youth  interviews. 

In  addition  to  group  instruction,  trainees  will  also  have  the 
opportunity  to  practice  administering  household  screeners  on  their 
own.  Local  telephone  numbers  will  be  used  for  the  practice  sessions, 
and  each  trainee  will  be  required  to  practice  for  four  hours. 

After  data  collection  starts,  followup  training  on  refusal- 
prevention  and  conversion  will  be  given.  Over  the  past  three  years, 
Westat  has  achieved  great  success  with  our  refusal  conversion  program, 
obtaining  refusal  conversion  rates  as  high  as  60%.  For  a  final 
refusal,  a  separate  CATI  module  that  asks  for  information  on  key  demo¬ 
graphics  of  the  refusing  respondent  and  the  respondent's  reason(s)  for 
refusing  to  participate  will  be  completed  whenever  possible. 


Duality  Controls  for  Interviews 


The  successful  conduct  of  a  large  survey  like  ACOMS  requires 
strict  control  over  the  activities  of  all  interviewers.  A  Telephone 
Research  Center  (TRC)  operations  manager  will  act  as  the  primary  liai¬ 
son  between  the  project  staff  and  the  TRC.  This  manager  will  coordi¬ 
nate  the  efforts  among  daytime,  evening,  and  weekend  interviewer 
shifts  and  will  ensure  that  adequate  staff  resources  are  assigned  to 
keep  the  survey  on  schedule.  The  manager  will  work  closely  with  shift 
supervisors  who  will  be  responsible  for  monitoring  interviewer  produc¬ 
tion  and  handling  problems.  Shift  supervisors  will  be  "on  the  floor" 
with  the  interviewers  at  all  times,  encouraging  interviewers  and 
ensuring  that  problems  are  quickly  identified  and  resolved. 


All  interviewers  will  be  closely  monitored  by  the  shift  supervi¬ 
sors.  Using  extension  telephones  and  displays  linked  to  interviewer 
CRTs,  supervisors  will  silently  monitor  at  least  10%  of  interviewer 
work  over  the  course  of  the  study.  An  interview  monitoring  report 
will  be  completed  each  time  a  call  is  monitored.  During  the  initial 
weeks  of  the  surveys,  the  results  of  the  monitoring  will  be  discussed 


with  each  interviewer  immediately  following  the  interview.  This  dis¬ 
cussion  will  provide  feedback  to  the  interviewer  on  incorrect  tech¬ 
niques  in  gaining  cooperation,  asking  questions,  answering  questions, 
or  recording  responses.  Thereafter,  unless  there  is  a  specific  prob¬ 
lem,  monitoring  reports  will  be  reviewed  with  each  interviewer  at  his 
or  her  weekly  meeting.  In  addition,  supervisors  will  review  the  moni¬ 
toring  reports  to  identify  common  problems  that  require  additional 
interviewer  training. 

Each  completed  case  can  be  sampled  and  reviewed  for  the  quality 
of  data  collected.  This  review  will  be  especially  important  in  making 
sure  that  an  interviewer  is  entering  comments  properly  and  recording 
any  text  responses  clearly.  Initially,  all  the  interviewer's  work 
will  be  reviewed.  Thereafter,  a  sample  of  each  interviewer's  work 
will  be  reviewed  periodically  to  ensure  that  quality  remains  high. 

Interview  Production  Reporting  and  Management  System 

Survey  control  depends  to  a  great  extent  on  the  computerized 
management  system  that  handles  interviewer  assignments  and  call-backs, 
as  well  as  validation  and  refusal -conversion  efforts.  This  system  is 
programmed  to  provide  study  managers  with  timely  information  on  survey 
progress,  quality,  schedule,  and  cost. 

In  the  CATI  RDD  system,  a  certain  number  of  phone  numbers  are 
initially  released  for  calling.  As  each  number  is  attempted,  a  result 
code  is  entered  into  the  system.  This  code  triggers  action  on  that 
particular  case  if  other  attempts  are  necessary  and  maintains  a  record 
of  each  call -attempt  made  to  each  assigned  number.  This  record  is  a 
complete  history  of  all  attempts  for  each  phone  number.  It  includes 
the  date,  time,  interviewer,  result,  and  appropriate  comments  for  each 
call -attempt. 

Supervisors  in  the  TRC  will  have  access  to  the  survey  control 
information  stored  in  the  CATI  system.  The  "call"  histories  of  prob¬ 
lem  cases  will  be  reviewed  both  by  supervisors,  to  determine  correc¬ 
tive  action,  and  by  interviewers  before  they  begin  to  work  on  such  a 
case.  An  abbreviated  call -record  can  be  displayed  before  the  inter¬ 
viewers  make  a  call -attempt  to  any  phone  number.  This  display  enables 
the  interviewers  to  review  any  comments  from  previous  calls  that  might 
be  useful  during  their  call-attempt. 


In  addition,  supervisors  will  use  the  CATI  management  information 
to  produce  various  reports  at  regular  intervals  during  the  survey. 
Status  reports  will  be  produced  to  show  the  status  of  all  selected 
cases  both  by  final  disposition,  such  as  complete  or  final  refusal,  as 
well  as  by  interim  disposition.  The  interim  dispositions  include 
callbacks  with  appointments,  callbacks  with  no  appointments,  first 
refusals,  numbers  that  have  not  yet  been  contacted,  eligible  cases 
which  have  been  contacted  but  the  interview  is  not  yet  complete,  and 
others . 


A  variation  of  the  status  report  is  a  display  that  the  telephone 
supervisor  can  access  at  any  time  to  show  how  many  active  cases  are 
assigned  to  the  telephone  center  at  that  time  and,  of  these  cases,  how 
many  are  appointments,  refusals,  and  cases  that  have  not  yet  been 
tried.  As  the  cases  are  worked,  the  system  updates  this  information 
so  that  the  supervisor  has  access  to  a  current  listing  of  available 
work.  This  display  is  arranged  by  hour  of  the  day  so  the  supervisor 
can,  for  example,  make  sure  that  all  appointments  scheduled  for  6:00 
p.m.  are  called.  The  report  also  shows  all  future  dated  appointments 
so  that  the  supervisor  can  adjust  staff,  if  necessary,  to  cover  all 
appointments . 

Reports  by  interviewer  are  also  produced.  These  reports  reflect 
disposition  of  each  contact  and  response  rate.  The  reports  also  pro¬ 
vide  the  staff  with  an  analysis  of  the  refusal-conversion  efforts  of 
each  interviewer.  The  reports  enable  the  staff  to  monitor  refusal - 
conversion  efforts,  identify  the  successful  refusal -conversion  inter¬ 
viewers,  and  determine  the  results  of  the  conversion  efforts. 

These  interviewer-specific  reports  enable  the  supervisor  to  iden¬ 
tify  those  interviewers  with  a  low  level  of  productivity  or  a  high 
rate  of  refusals  and  will  be  used  to  identify  staff  who  may  need  addi¬ 
tional  training  or  who  should  be  dismissed  from  the  study. 


Data  Processing  and  Documentatior 


Data  Editing 


The  Westat  CATI  system  shapes  not  only  the  data  collection 
process,  but  also  the  data  processing  and  documentation  plan.  Since 
Westat' s  CATI  system  will  provide  on-line  range  checks  and  consistency 
edits  in  addition  to  enforcing  all  skip  patterns,  extensive  after-the- 
fact  machine  editing  will  not  be  required.  As  an  additional  check, 
however,  Westat  will  run  unweighted  frequencies  on  all  variables 
collected  during  the  CATI  interviews  using  either  SAS  or  proprietary 
Westat  software  (CHESFREQ) .  These  frequencies  will  check  for  incom¬ 
plete  data,  range  errors,  input  errors,  and  incorrect  branching. 

During  the  early  stages  of  the  project  the  frequencies  will  be  run 
often  in  order  to  discover  possible  problems,  and  later,  they  will  be 
run  on  a  monthly  basis.  Frequencies  will  also  be  run  to  check 
midquarter  changes  in  questionnaire  administration  (for  instance,  if  a 
particular  question  is  asked  only  during  specific  months) .  Any  prob¬ 
lems  discovered  at  this  stage,  such  as  CATI  programming  errors,  will 
be  corrected  by  Westat  in  consultation  with  the  Contracting  Officer's 
Representative  (COR) . 

These  unweighted  frequencies  will  also  be  delivered  to  the  COR  on 
a  monthly  basis  for  review.  The  frequencies  will  provide  8 -character 
variable  names,  40-character  variable  labels,  16-character  value 
labels,  counts,  and  percentages.  Frequencies  will  be  provided  for 
most  of  the  nonderived  variables  on  the  data  base.  (The  only  vari¬ 
ables  that  will  be  completely  excluded  will  be  those  items  for  which 
frequencies  would  make  no  sense,  such  as  verbatim  responses  to  open- 
ended  questions.  In  addition,  frequencies  on  confidential  data  items 


will  be  limited  to  providing  information  about  various  different  types 
of  nonresponse,  such  as  "Refused"  and  "Don't  Know".)  These  frequen¬ 
cies  will  be  produced  only  as  a  check  on  data  quality;  since  they  will 
not  be  weighted,  they  will  not  be  useful  for  analytic  purposes. 

Data  Review  and  Preparation 

The  ACOMS  data  preparation  operation  consists  of  a  staff  of 
coders  and  their  supervisor  who  are  responsible  for  four  tasks: 

(a)  reconciliation  of  inconsistent  geographic  information  obtained 
during  the  screener  interview,  (b)  unitizing  verbatim  responses  to  the 
open-ended  questions  KR-15  and  KR-17,  (c)  assigning  a  unique  numeric 
code  to  each  unitized  phrase,  and  (d)  updating  the  data  base. 

A  screener  interview  will  be  batch-processed  after  it  is  com¬ 
pleted  to  assign  an  Area  of  Dominant  Influence  (ADI),  Standard 
Metropolitian  Statistical  Area  (SMSA) ,  and  recruiting  brigade  to  the 
case.  If  inconsistent  information  is  encountered  during  the  batch 
process,  the  case  will  be  assigned  to  data  preparation  and  resolution. 
Coders  will  review  the  screener  information  to  obtain  the  source  of 
the  inconsistency  and  then  receive  it. 

When  a  youth  or  parental  interview  is  completed,  the  CATI  sched¬ 
uler  will  automatically  assign  the  case  to  a  data  preparation  file. 
Coders  will  "unitize"  the  verbatim  responses  to  the  two  open-ended 
questions.  "Unitization"  is  the  process  of  separating  distinct  ideas 
prior  to  coding.  Thus  a  verbatim  response  containing  more  than  one 
distinct  thought  will  be  unitized  into  separate  phrases  for  each 
thought;  otherwise,  it  will  be  left  as  a  single  unitized  phrase. 

Coders  will  then  assign  a  unique  numeric  code  to  each  unitized  phrase 
by  first  determining  the  general  category  to  which  it  belongs  and  then 
determining  if  it  fits  well  into  a  specific  subcategory  within  the 
general  category.  These  numeric  codes  are  illustrated  in  Figure  11 
with  the  subcategories  indented  and  located  underneath  their  respec¬ 
tive  general  category. 

Another  process  involves  updating  the  data  base  to  correct  infre¬ 
quent  yet  nonpreventable  interviewer  errors.  Sources  of  such  updates 
are  update/comment  sheets  and  interviewer  comments  inserted  during  the 
interview.  If  an  interviewer  error  occurs  while  conducting  the  inter¬ 
view,  an  update/comment  sheet  documenting  the  error  will  be  filled  out 
and  a  comment  will  be  inserted  within  the  interview  where  the  error  is 
detected.  The  interviewer  will  give  the  update/comment  sheet  to  the 
shift  supervisor  who,  after  reviewing  the  sheet,  will  submit  it  to  the 
data  preparation  operation  for  correction. 


The  data  preparation  staff  will  also  review  the  file  of  comments 
for  all  ACOMS  interviews.  This  will  help  detect  interviewing  errors 
for  which  an  update/comment  sheet  was  either  misplaced  or  not  com¬ 
pleted.  Coders  will  create  a  transaction  file  that  lists  the  case 
identification  number  (ID),  the  specific  variable  requiring  an  update, 
and  the  old  and  new  values  of  the  variable.  Coders  will  then  submit 
the  transaction  file  to  the  CATI  utility  CASEUPDT  which  performs  the 
desired  update. 
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1<M)  Service 


110  A  chance  to  aarva  your  otn 

120  An  opportunity  to  aarvo  Anar  lea 
tdiile  staying  in  your  o*n  hone 
town 

130  unique  oppornnitiea  to  serve 
part-time  in  the  ailitary  Uifle 
working  in  a  civilian  job 

140  A  way  o/  participating  in  a  tfaa* 
honored  Anar  lean  tradition 

ISO  An  experience  you  can  bo  proud  a* 

161  Serve  your  country 

-  'keep  your  cawitry  free* 

•■Oof end  the  nation* 


200  Challenge 

210  A  phyaicatty  challenging 
envi r orient 

220  A  Mentally  challenging  experience 

300  job/Career  0 eve l  ocean t 

310  Many  opportuiitiea  for  training  in 
useful  skill  areas  (medical 
technology,  mechanics,  coeexjters, 
electronics) 

320  A  wide  variety  of  oppornnitics  ta 
find  a  job  you  can  enjoy 

330  The  chance  to  work  with 
sophisticated,  high-tech  equipment 

340  A  great  value  in  your  civilian 
career  developaant 

331  Vocational  training 

400  Self- Development 

•■make  something  of  yoursalf* 

-*te  a  batter  person* 

•■Builds  character* 

410  Tha  best  opportunity  to  devalop 
leadership  skills 

420  An  excellent  opportunity 

430  An  opporunity  to  develop  into  a 

responaibla,  mature  parson 

440  Tha  opportuiity  to  develop  your 
potential 

•■Be  all  you  can  bo* 

4S0  An  advantage  over  going  right  from 
high  school  to  col lege 


460  Many  chances  to  work  with  high* 
quality  people 

471  Develop  discipline 

461  Develop  pride 
S0Q  Noney/laneflts 

••GOOd 

-■Cash  bona* 

•*0J  Bill" 

600  Edueation/Banefits 

•■Data  you  an  education* 

•■Sands  you  to  collage* 

700  Travel 

•*A  chance  to  travel  to 
interesting  places* 

•■See  the  world* 

•■Co  pieces* 

800  (fragmented)  Ispressiona 

810  Interesting  and  exciting  weekends 
B21  Adventure 

822  Excitement 

823  fun 
831  Respect 

861  Opportuiity 

891  Learning 
861  Experience 

871  Help 
881  future 
900  Other 

911  Detailt/description  of 

edvertisement(s) 

921  teeatt  of  advertising  slogan 

931  Oitbelief  in  sdvortismesnt 

941  Doesn't  pay  attention  to 

advertisements 

991  Join/ anil st 

961  Positive  aiacal laneoua  eomants 

971  negative  aiscal laneoua  ccaeunts 

981  Don't  remoter /don't  knew/none/ 

nothing 


Figure  11.  Open-ended  coding  guide  for  interviewers 


Data  tapes  for  ACOMS  will  be  delivered  in  two  stages.  The  first 
stage,  the  "questionnaire  tape",  will  consist  of  all  variables 
collected  directly  by  the  CATI  interviews,  as  well  as  case  weights  and 
the  results  of  any  open-ended  coding.  The  second  stage,  the  "derived 
variable  tape",  will  consist  of  derived  variables  constructed  during 
the  analysis.  The  development  and  documentation  of  these  derived 
variables  will  be  discussed  with  the  U.S.  Army  Research  Institute 
(ARI).  This  two-stage  process  will  allow  the  quickest  possible  deliv-; 
ery  of  the  raw  questionnaire  data  to  ARI  for  their  use,  while  still 
providing  a  complete  set  of  additional  analytic  variables,  once  these 
are  created  by  Westat. 

Each  set  of  data  will  be  supplied  in  both  raw  data  format  and  as 
SAS  data  sets.  The  raw  data  files  will  be  on  9- track,  unlabeled, 
1600-BPI  tapes,  using  EBCDIC  character  representation.  For  these  raw 
data  tapes,  the  hierarchical  file  structure  used  by  CATI  will  be  main¬ 
tained.  Logically  distinct  types  of  information,  particularly  infor¬ 
mation  that  may  be  collected  more  than  once  per  case  (e.g.,  contact 
information  to  document  each  telephone  call) ,  are  maintained  in  sepa¬ 
rate  physical  subfiles  or  "segments".  The  data  from  these  segments 
may  be  joined  in  any  desired  manner  for  analysis  by  using  the  SAS 
"MERGE"  command  or  the  SPSS-X  "MATCH  FILES"  command.  Note  that  older 
versions  of  SPSS  have  much  less  flexible  file -manipulation  capabili¬ 
ties.  A  significant  amount  of  additional  programming  would  be 
required  to  reformat  the  complex  ACOMS  data  bases  so  that  they  would 
be  easily  usable  by  earlier  versions  of  SPSS.  Because  of  cost  consid¬ 
erations,  Westat  is  not  currently  planning  to  undertake  such  a  refor¬ 
matting  effort. 

Figure  12  lists  all  the  segments  contained  in  the  ACOMS  CATI  data 
base.  This  figure  indicates  which  segments  are  deliverable,  which 
will  be  contained  in  the  merged  analytic  SAS  files,  and  which  vari¬ 
ables  on  deliverable  segments  contain  confidential  information. 

The  SAS  data  sets  will  be  on  9 -track,  1600-BPI  tapes  with  IBM 
standard  labels.  In  order  to  facilitate  analysis,  these  data  sets 
will  be  organized  as  "flat"  files,  rather  than  following  the  hierar¬ 
chical  organization  of  the  CATI  data  base.  All  information  (except 
for  open-ended  items)  for  each  interview  respondent  will  be  contained 
in  a  single  file.  The  only  information  that  will  be  contained  in  the 
SAS  files  will  be  for  completed  interviews.  In  other  words,  they  will 
not  contain  information  on  business  phone  numbers,  ineligible  house¬ 
holds,  or  refusals.  One  SAS  file  will  contain  open-ended  text  and 
codes  for  all  completed  youth  interviews,  while  a  second  will  contain 
all  other  data  for  the  youth.  A  similar  procedure  will  be  followed 
for  parent  interview  data. 

SAS  formats  (value  labels)  will  be  used  to  document  the  meaning 
of  all  coding  schemes  used,  including  missing-value  codes.  The  SAS 
formats  themselves  will  be  provided  on  tape  both  as  a  SAS  format 
library  and  in  source -code  form. 


! 


incuoa  in 

i  inefuda  in  Conldamiai 

INania _ 

Dascnonon 

CATI  Databaaa? 

SAS  Fitaa?  i  itama 

I 

BASE  i  information  tor  in*  housanoid 

Yaa 

Saiactad  vanadiaa 

EXCH.  LOCL  PHCNCrTY 

■  jsawnoto 

j 

ENUM  I  Youtfl  anumaration  in 

Yaa 

Yaa 

EFNAM.  ELNAM. 

iscraanar 

E 00600.  EOOBMM. 

1  -  - 

E008YY 

1 

BABY  I  Tracts  mo  information  tor 

No 

NO 

N/A  (no  data  daiivarad) 

iHH  witfi  voutn  13*15 

8A$M 

I  HousMMoma  into  lor 

*•8 _ j  Onfy  tna  vanaota _ 

YPARFNAM.  YPARLNAM 

aacn  rtsoondam  soiactad 

MAINOATE 

YPAREXCH.  YPARLOCL. 

lor  mtorvtow 
- 

BASMEXCH. BASMLOCl 

Yirrw 

information  from 

Yaa 

Taa  . . 

YOCITY  YOSSN 

voutn  intamaw 

GLOY 

Semen  saomant  tor 

NO 

NO 

N/A  (no  data  datrvarad) 

voutn  intarviaw 

TRAK 

Tracfcma  information  for 

NO 

No  N/A  (no  oata  daWomd)  ! 

tonoitudinaf  voutn 

YVEB 

Uncodad  rasoonsas  to 

Notsaa  YUNI) 

.Noiaaa  yunq _ 

N/A  (no  data  dattvarad) 

ooan-andad  auastnna 

1  1 

YUNI 

Unitizad/codad  rasoonsaa 

Yaa 

Yaa  (saooma  «a) 

Nona 

to  ooan-andad  auastiona 

YERR 

Semen  saomant  lor 

Nd 

NO 

n/a  mo  data  oaiwarad) 

codmo  vanftcanon 

PARN 

information  from 

Yaa 

Yaa 

Nona 

Darant  mranAaw 

GLOP 

Scratcn  saomant  lor 

No 

NO 

N/A  (no  data  daiivarad) 

oarant  warvUar 

PV6B 

Uncodad  raaoonaaa  to 

NotaooPUNn 

Notsaa  PLIW 

N/A  (no  data  daiivarad) 

ooan-andod  ataatlona 

PUNt 

Unifizadtcooad  raaoonaaa 

Yaa 

Yaa  (saoama  wai 

Nona _ 

to  ooan-andad  auaaMona 

P6RR 

Semen  saomant  tor 

No 

NO 

N/A  (no  data  daiivarad) 

ooano 

SURV 

CATI  'cal  raoo<dr 

NO 

NO 

N/A  (no  data  daHvarad) 

SKEO 

CAT!  aeftadufar  Information 

NO 

NO 

N/A  (no  daa  dasvarad) 

rBS“ — 

NIRf 

llAAflAAIMMA  IdA* 

NO 

NO 

N/A  (no  data  dasvaradl 

toriatuaala 

TRAC 

imo  toe  ifioonoonii 

NO 

NO 

N/A  (no  dau  daHvaradl 

wtio  mova  dudna  data 

co^vdtoA 

GEOG 

Semen  Momant  tor 

NO 

NO 

N/A  (no  data  dasvarad) 

_ 

J42S3E2SL222SS _ 

Figure  12.  ACOMS  CATI  data  base  segments 


As  of  October  13,  1986,  we  have  not  yet  made  a  final  decision 
regarding  the  codes  that  will  be  used  to  represent  missing  values.  We 
will  examine  the  Youth  Attitudes  Tracking  Survey  (YATS)  (Research 
Triangle  Institute,  1985)  coding  schemes  to  see  whether  or  not  similar 
codes  can  be  used  for  ACOMS.  Special  missing- value  codes  will  be  used 
to  indicate  items  that  are  not  asked  during  a  particular  quarter,  due 
to  questionnaire  revisions. 

Although  Westat  will  maintain  all  information  collected  during 
ACOMS,  all  confidential  information  will  be  blanked  out  on  the  deliv¬ 
ered  ACOMS  data  bases.  Confidential  information  consists  of  names, 
dates  of  birth,  addresses  (except  for  county  and  ZIP  code) ,  Social 
Security  numbers,  and  telephone  numbers,  except  for  area  code.  Westat 
will,  of  course,  retain  such  information  as  part  of  its  ongoing  survey 
management  effort.  If  requested  by  ARI,  Westat  will  provide  link 
files  containing  study  IDs  and  Social  Security  numbers  to  other 
contractors  for  research  purposes. 

Tape  Documentation 

Documentation  for  all  ACOMS  tapes  will  be  delivered  in  three -ring 
binders.  Each  set  of  documentation,  as  well  as  each  revision  or  addi¬ 
tion  to  this  documentation,  will  be  treated  as  an  ARI  Working  Paper. 
The  tape  documentation  will  include  the  following  items: 

(1)  Tape  format  information; 

(2)  File  layout  (CATI  code  book  and  SAS  Proc  Contents);  and 

(3)  An  annotated  hard-copy  questionnaire. 

Documentation  for  constructed  or  derived  variables,  or  variables 
that  are  produced  by  coding  open-ended  responses,  will  either  be 
incorporated  into  the  CATI  code  book,  as  illustrated  in  Figure  13,  or 
will  be  presented  as  a  separate  section. 

The  tape  format  information  will  document  the  physical  character¬ 
istics  of  the  tape.  It  will  include  the  tape  volume  number,  tape 
density,  labeling  used  (IBM  standard  labels  or  unlabeled) ,  character 
representation  (standard  EBCDIC  data  or  SAS  data  set),  file  name, 
record  format,  block  size,  record  count,  and  data  description  such  as 
Phase  2  ACOMS  data,  or  source  code  for  SAS  format  library. 

Two  forms  of  file  layout  will  be  provided:  a  CATI  code  book 
(Figure  13),  and  a  SAS  PROC  CONTENTS  (Figure  14).  Each  will  be 
supplied  in  both  printed  and  machine -readable  format.  The  CATI  code 
book  will  contain  the  following  items  for  each  variable:  (a)  segment 
name,  (b)  variable  name,  (c)  column  number (s ) ,  (d)  40-character  vari¬ 
able  label,  (e)  response-  codes ,  (f)  missing  data  codes,  and  (g)  16- 
character  value  labels.  The  SAS  PROC  CONTENTS  will  include  the 
following  items  for  each  variable:  (a)  segment  name,  (b)  variable 
name,  (c)  position  on  dataset,  (d)  data  type  (numeric  or  character;, 

(e)  40-character  variable  label,  and  (f)  SAS  format  name,  if 
applicable . 
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Var i *b I  * 

Nan* 


YEDKINO 


YEDENYRH 


YEOENYRC 


Col uran 
Nu»b*r(») 


27-28 


EE8  KINO  OF  SCHOOL  YOUTH  ENROLLED  IN 


29-30 


31-32 


-1 

INAPPLICABLE 

-7 

REFUSED 

-8 

DK 

-9 

NOT  ASCERTAINED 

1 

REGULAR  HIGH  SCHOOL 

10 

SOME  OTHER  SCHOOL 

2 

GEO  OR  HIGH  SCHOOL  EQUIVALENCY 

3 

ABE  (ADULT  BASIC  EDUCATION) 

4 

SKILL  DEVELOPMENT  PROGRAM 

3 

ON  THE  JOB  TRAINING  PROGRAM 

i 

APPRENTICESHIP  PROGRAM 

7 

VOCATTOWL,  8USINESS  OR  TRADE  ! 

8 

2  YEAR  JR  OR  C01T1  UNITY  COLLEGE 

9 

4  YEAR  college  or  university 

EE  4A 

IS  Y 

IN 

GRADE  9,  10,  11,  OR  12 

-1 

INAPPLICABLE 

-7 

REFUSED 

-8 

DK 

-9 

NOT  ASCERTAINED 

10 

10TH  GRADE 

11 

1 1TH  GRADE 

12 

1ZTH  GRADE 

9 

9TH  GRADE 

m 

m 

<►. 

CD 

IS  Y 

IN 

1,  2,  3,  4,  5  YR  COLLEGE 

-i 

INAPPLICABLE 

-7 

REFUSEO 

-8 

OK 

-9 

NOT  ASCERTAINED 

I 

1ST  YR  (FR) 

2 

2ND  YR  (SOPH) 

3 

3RO  YR  (JR) 

4 

4TH  YR  (SR) 

3 

3TH  YR 

Figure  13.  CATI  code  book  sample 
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rV*T" 1 


KSA2:inOR?43213.8?l]  '4:U  MCNOAT.  DECEMBER  21. 

cwtbtts  procedure 

UNWITS  OF  SAS  HB1SER  Ol.YUTHKIN 

m met  OF  0HSERUATI1KS:  1797  NIKBER  OF  UARiASLfS:  730 

N64TYPE:  OAT* 


- ALPM8ET1C  LIST  Of  variables  fho  attributes — 


•  variable  tyre 

L9IGTH 

POSITltN  P0IKAT  INfOfKAT 

LABEL 

41  A01  CHAR 

3 

304  4A01F14. 

AREA  OF  DIK1NANT  INFLUENCE  (1983) 

4?3  Awararr  mu 

2 

2379 

SC3  HQ4  MANY  OLDER  THAN  24 

42  AREA  CHAR 

3 

309  ICHAR3. 

HH  PWKE  NIKBER  AREA  CODE 

43  ATTPLACE  CHAR 

10 

312  ICHAR10. 

HH  PLACE  NAKE,  AT4T  TAPE 

89  BASYFLG  NIK 

2 

417  BMTF1613. 

IS  THERE  A  13-13  YEAR  0U>  IN  HH 

192  BE4QK  NIK 

2 

478  CCHECX13. 

CB4ST.  CHECK:  BE2,  8E4 

34  BRIGADE  NIK 

2 

294  RCTG30E13. 

USAREC  RECRUITING  BRIGADE 

37  BR1GDATT  CHAR 

2 

298  18RS8T13. 

m  BRIGAOE/BATTALKK  RS1D  COSE 

1  CASE ID  CHAR 

8 

0  4CHAR8. 

HOUSEHOLD  ID  NIKBER 

24  CLUS1D  NIK 

3 

43 

3  DIGIT  OUSTER  ID0TIFIER 

43  CNTYFIPS  CHAR 

3 

347  1CHAR3. 

HH  C01KTY  FIPS  CODE 

100  E13T024  NIK 

2 

484  AGERANG13. 

SC18A  AGE  CATEGORY  (IF  AGE  HISSING) 

79  EASE  NIK 

3 

483 

SC10  AGE  OF  YOUTH  (IF  008  HISSING) 

14  ECAICAGE  NIK 

3 

42 

SC9  CALCULATED  AGE  FREK  DATE  OF  BIRTH 

94  EOOBOO  NIK 

2 

477 

SC?  YOUTH  DATE  OF  BIRTH,  DAY 

97  ED0991  NIK 

2 

479  008N4TH13. 

SC?  YOUTH  DATE  OF  BIRTH,  MONTH 

98  EDOBTY  NIK 

2 

491 

SC?  YOUTH  DATE  OF  BIRTH,  YEAR 

134  EE19CHK  NIK 

2 

338  CCHEOC13. 

EE1?  CONST.  CHECX:  CUR  SIP  VS.  NO  JOG 

124  EE1CHK  NIK 

2 

334  CCHECXIS. 

EEI  CONST.  CHECK:  EE]  VS.  AGE 

124  EE3CHK  NIK 

2 

331  CCHEOH3. 

EE3  COST.  CHECX:  EEI  VS.  EE3 

398  EE3CHX  NIK 

2 

1543  COCCK13. 

CONST  CHECK:  LAST  DATE  IN  SCHOOL  VS.  NtV 

718  EEDCGRAO  NIK 

2 

2213  TESN013. 

SCI3C  1$  YOUTH  A  COLLEGE  GRADUATE 

187  EEDCOir  MK 

2 

389  EEDCWP17. 

SCI 3  HIGHEST  LEVEL  OF  E0UC  CWPtETEO 

111  EEDCAJER  NIK 

2 

388  TEM13. 

SCI 31  VERIFIES  SCHOOLING  COMPLETED 

104  EEDBCUR  NIK 

2 

498  YE94013. 

SC14  IS  YOUTH  CURRENTLY  IN  SCHOOL 

789  EEDBRJTH  NIK 

2 

2211  YE9401S. 

SCI 41  IS/UAS  YOUTH  ENROLLED  APRIL/0CT0BE 

708  EED0IS1K  NIK 

2 

2209  E0SIK13. 

SCI4A  SCHOOL  Y  ENROLLED  IN  HAY-SEPT 

108  EEDENTYP  NIK 

2 

502  EOB4TYP14. 

SC13  TYPE  SCHOOL  Y  CURRENTLY  ENROLLED 

110  EE0ENYRC  NIK 

2 

304  EDBffRCIS. 

SCI 7  YOUTH  IN  1,2,  3,  4,  3  YR  COLLEGE 

109  EEDCNYRH  NIK 

2 

384  ESSIYRHIS. 

SCI 4  Y  CURROTLY  IN  9,  10,  11,  12  GRADE 

494  EEOSflflM  NIK 

2 

2181  EEW4YRJ13. 

SC17A  IS  Y  IN  1ST  OR  WD  YR  OF  JR  COLLES 

94  EFNAK  CHAR 

23 

427  4CHAR23. 

SCI  YOUTH'S  FIRST  NAME  (STATUS) 

18  EHJSP  NIK 

2 

31  YEM13. 

SC2B  IS  YOUTH  HISPANIC 

103  EHS01PL  NIK 

2 

494  YHS0IPU4. 

SC13A  TYPE  OF  HIGH  SCHOOL  DIPUKA 

18  ELiSTrm  NIK 

2 

34  ELJ6TYPI3. 

YOUTH'S  SAWli  CEIL,  BASED  ON  MAIN  INI 

9  EL16TYPS  Ntfl 

2 

32  ELIGTYP13. 

YOUTH'S  SAWLE  CELL,  BASED  ON  SCREBCR 

112  EUUAD0RWK 

2 

318  TE9I015. 

SCII  DOES  YOUTH  LIVE  AT  THIS  AOORESS 

113  aiVDOK  NIK 

2 

312  YEM13. 

SC18A  DOES  Y  LIVE  IN  STUDENT  HOUSING 

n  eum  cm 

23 

432  9CHM23. 

SC21  YOUTH'S  LAST  NAME  (STATUS) 

102  milACT  NIK 

2 

498  TEM13. 

SCI!  YOUTH  EVER  IN  ACTIVE  NIL/NS/RESEW 

104  EHILSERV  NIK 

2 

494  YE3N013. 

SCIIA  IS  YOUTH  P9ES9ETLT  IN  MILITARY 

103  B11UMIT  NIK 

2 

492  YESN013. 

SC12  YOUTH  VAITING  TO  GO  IK  ACTIVE  DUTY 

80  8RKT0T  NIK 

2 

399 

TOTAL  YOUTH  AGED  13-24  FINAL 

17  ERACE  NIK 

2 

49  RACE14. 

SCI?  YOUTH'S  MCE 

Figure  3.4.  Contents  of  SAS  data  set. 
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In  addition  to  the  CATI  code  book  and  PROC  COMMENTS,  all  tapes 
will  be  accompanied  by  an  annotated  copy  of  the  hard-copy  question¬ 
naire  (Figure  15) .  For  each  ACOMS  data  item,  this  document  will 
provide,  at  a  minimum,  the  question  number,  variable  name,  full  text 
of  the  question  and  all  precoded  responses,  skip  pattern  information, 
and  logic  and  consistency  checks.  Note  that  some  items  that  result 
from  the  CATI  development  process,  such  as  data  flags,  will  be  present 
as  variables  in  the  data  file  and  file  layouts,  but  will  not  be 
included  in  the  hard-copy  instrument. 

The  questionnaire  version  (e.g.,  "871"  for  the  October-December 
1986  data  collection  period) ,  as  well  as  information  providing  the 
date  and  time  of  each  interview,  will  be  maintained  on  the  ACOMS  data 
bases.  Westat  will  attempt  to  maintain  the  same  record  position  for 
particular  questions  across  different  questionnaire  versions. 

However,  this  will  mean  that  newly  added  questions  must  be  placed  at 
the  end  of  the  relevant  file  segment,  rather  than  in  logical  question¬ 
naire  order. 

Data  Imputation  and  Auditing 

The  only  imputations  that  Westat  will  perform  on  the  data  base 
will  be  those  required  by  weighting  poststratif ication.  The  variables 
are  age,  race,  and  (for  annual  weights  only)  parent's  education.  The 
results  of  these  imputations  will  be  contained  in  separate  variables 
on  the  analytic  SAS  data  file,  so  that  the  originally  collected  data 
will  be  maintained. 

Westat' s  CATI  system  maintains  a  complete  audit  trail  of  all 
keystrokes  entered  by  the  interviewer  during  each  interview.  This 
facility  enables  project  staff  to  reconstruct  the  exact  flow  of  an 
interview  for  questionable  cases.  In  addition  to  this  system,  Westat 
will  maintain  a  record  of  any  changes  made  to  the  data  base  after 
interviews  are  completed. 

While  these  audit  trails  will  be  available  to  the  COR  for  exami¬ 
nation,  they  will  not  become  a  part  of  the  deliverable  data  tapes. 

With  the  exception  of  the  imputed  variables ,  only  the  final  version  of 
each  variable  will  be  maintained  on  the  data  tapes. 

Users'  Manuals 


Westat  will  develop  and  provide  Users'  Manuals  at  the  end  of 
Phase  2  and  at  the  end  of  each  subsequent  year.  Unlike  the  tape  docu¬ 
mentation  which  will  be  delivered  in  three -ring  binders,  the  Users' 
Manuals  will  be  produced  in  a  more  permanent  format.  Each  manual  will 
consist  of  five  sections: 

(1)  Introductory  text; 

(2)  A  question  bank  listing; 

(3)  An  enhanced  CATI  code  book; 

(4)  Annotated  hard-copy  questionnaires;  and 

(5)  A  topic  index. 
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3E-1A.  Have  you  ever  talked  with  any  military  recruiter  to 
get  information  about  the  military? 


MO  .  2 

REFUSED  .  -7 

DON'T  KNON .  -8 


8E-1. 


In  the  past  six  mnntha.  have  you  cal  Iced  with  anyone 
about  possibly  joining  the  Army? 


YES . 

NO  . 

REFUSED  .. 
DON'T  KNOW 


1  (BE-2) 

2  (BE-10J 

-7  (BE-10) 

-8  (BE-10) 


BE-2.  With  whoa  have  you  talked? 

[RECORD  ALL  THAT  APPLY.  USE  CTRL/P  TO  EXIT.] 


FRIENDS  .  01 

MOTHER  .  02 

FATHER  .  03 

A  BROTHER  OR  SISTER  .  04 

SOME  OTHER  RELATIVE  .  05 

BOY/GIRL  FRIEND  OR  SPOUSE  .  06 

A  TEACHER .  07 

A  COUNSELOR  AT  SCHOOL  .  08 

A  RECRUITER  .  09 

CO-WORKER  .  10 

EMPLOYER .  11 

OTHERS  .  12 

REFUSED  .  -7 

DON’T  KNOW .  -8 


CAT I  CHECK  IBE1 :  WERE  FRIENDS  MENTIONED? 
[BE-2  -  01) 


YES  .  1  (SE-3) 

NO  .  2  (CAT I  CHECK  #BE2) 


Figure  15.  Annotated  hard-copy  questionnaire 


-ACOMS  Annotated  Questionnaire 
Quarter  87-4  (Jul,  Aug,  £  Sep  87) 
Module:  Behaviors 


Screen  Name: 
Variables : 
YBAEVREC 
Sub-Population : 

BE-1  A 

Ranges : 

1,2, -7, -8 

All  youth 

Order  # : 

176 

Screen  Name: 

Variables: 

YBATALK 

BE-1 

Ranges: 

1,2, -7, -8 

Order  #: 

177 

Sub-Population:  All  youth 


Screen  Name: 

BE- 2 

Variables : 

Ranges: 

Order  #: 

ybafren 

1,2, -7, -8 

178 

YBAMOM 

1,2, -7, -8 

179 

YBADAD 

1,2, -7, -8 

180 

YBASIB 

1,2, -7, -8 

181 

YBAREL 

1,2, -7, -8 

182 

YBASPOU 

1,2, -7,-8 

183 

YBATEAC 

1,2, -7, -8 

184 

YBACOUN 

1,2, -7, -8 

185 

YBAREC 

1,2, -7, -8 

186 

YBACOW 

1,2, -7, -8 

187 

YBABOSS 

1,2, -7, -8 

188 

YBAOTH 

1,2, -7, -8 

189 

Sub-Population : 

Youth  who  have  talked  with  someone  about 
joining  the  Army 
[YBATALK  (BE-1)  EQ  1] 

Figure  15,  Annotated  hard-copy  questionnaire  (continued) . 
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The  first  section  of  the  Users'  Manual  will  consist  of  written 
text.  This  section  will  provide  an  overview  of  the  ACOMS  survey.  It 
will  include  discussions  of  the  various  ACOMS  samples,  interviewing 
and  data  editing  procedures,  response  rates,  weighting,  and  any 
special  restrictions  or  cautions  about  using  the  data. 

The  second  section  will  be  a  listing  of  the  ACOMS  question  bank 
(Figure  16).  The  question  bank  includes  all  items  that  have  been 
included  in  any  version  of  the  ACOMS  questionnaire,  as  well  as  items 
under  consideration  for  inclusion  in  future  versions.  Each  question 
bank  entry  lists  the  full  text  of  the  question  and  response  categories 
and  provides  a  cross-reference  to  the  questionnaire  version  or 
versions  in  which  the  item  is  used.  (During  Phase  3,  Westat  will 
investigate  the  feasibility  of  supplementing  the  question  bank  with  a 
more  abbreviated  cross  -  reference  listing,  which  would  contain  variable 
name,  variable  label,  and  questionnaire  versions  in  a  one -line -per  - 
item  format.)  Information  is  also  provided  about  the  subset  of 
respondents  to  which  the  question  applies  (effect  of  questionnaire 
branching),  the  research  objectives  that  relate  to  the  item,  and  the 
use  of  similar  items  in  other  surveys  such  as  YATS . 

The  third  section  of  the  Users'  Manual  will  be  an  "enhanced"  CATI 
code  book.  This  code  book  will  be  basically  similar  to  that  which 
will  be  provided  as  a  part  of  the  regular  tape  documentation  (Figure 
13).  In  addition  to  the  standard  information  such  as  segment  name,  8- 
character  variable  name,  column  number (s ) ,  40-character  value  labels, 
the  enhanced  code  book  will  include  unweighted  frequency  counts  and 
percentages  for  the  main  ACOMS  samples  and  for  the  total  sample.  The 
frequencies  will  combine  responses  for  all  cases  interviewed  during 
the  period  of  interest,  either  Phase  2  or  annual.  Space  considera¬ 
tions  will  dictate  some  limits  on  the  number  of  columns  of  frequency 
information  that  can  be  included  in  the  code  book. 

The  fourth  section  of  the  Users'  Manual  will  contain  one  or  more 
annotated  hard-copy  questionnaires.  For  full-year  tapes  on  which  data 
is  related  to  more  than  one  questionnaire  version,  a  copy  of  each  ver¬ 
sion  will  be  supplied.  As  previously  described,  each  annotated  ques¬ 
tionnaire  will  include  question  number,  variable  name,  full  text  of 
the  question  and  all  precoded  responses,  skip  pattern  information, 
relevant  sub-population,  and  logic  and  consistency  checks. 

The  final  section  of  the  Users'  Manual  will  be  a  topic  index. 

The  topics  will  be  based  upon  the  ACOMS  questionnaire  modules.  Each 
entry  in  the  index  will  include  the  topic  name,  8-character  variable 
name,  and  40-character  variable  label.  The  index  will  be  arranged 
alphabetically  by  topic. 
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6.  THE  FORMAL  PRETEST 


Linda  J .  Keil 
Introduction 


The  design  phase  for  the  Army  Communications  Objectives  Measure¬ 
ment  System  (ACOMS)  survey  was  capped  by  a  formal  pretest,  in  which 
all  the  project  procedures  and  questionnaires  were  tested  under  opera¬ 
tional  conditions.  During  the  pretest,  actual  telephone  numbers  were 
contacted  and  screened  to  locate  households  and  interview  a  total  of 
about  100  eligible  respondents .  The  formal  pretest  was  intended  to 
provide  an  indication  of  what  might  be  expected  during  the  actual  data 
collection  process,  and  to  test  and  refine  all  project  procedures  and 
instruments . 

More  specifically,  the  formal  pretest  had  three  major  purposes: 

(1)  Training:  The  pretest  was  intended  to  provide  a  preliminary 
test  of  the  materials  and  procedures  developed  for  training  telephone 
interviewers  to  conduct  the  ACOMS  study.  In  particular,  the  training 
package  was  to  be  evaluated  in  terms  of  the  ease  with  which  inter¬ 
viewers  are  able  to  follow  instructions  as  given,  the  comprehensive¬ 
ness  of  the  training  package  in  dealing  with  the  problems  likely  to  be 
encountered  during  interviewing,  and  the  usefulness  of  the  training 
materials  both  during  the  initial  training  period  and  as  reference 
tools  for  use  while  interviewing. 

(2)  The  Computer-Assisted  Telephone  Interview  system  (CATI) 
programming  test:  The  pretest  was  also  intended  to  test  the  CATI 
programming  of  the  questionnaire.  Of  particular  interest  were  skip 
patterns,  consistency  checks  (for  eliminating  errors  in  entering  codes 
that  are  out  of  range,  and  for  reducing  in-range  coding  errors  by 
checking  "unlikely"  responses),  and  checks  on  the  programmed  selection 
of  eligible  respondents. 

,3;  Questionnaire  construction:  The  pretest  was  intended  to 
-ide  the  first  formal  evaluation  of  the  youth  and  parental  ques- 
t_.nnai’*e  under  actual  CATI  conditions.  Of  particular  interest  were 
the  average  length  of  administration  for  the  household  screener,  youth 
interview,  and  parental  interview,  and  question  wording,  flow,  and 
formatting. 

The  pretest  was  not  intended  to  provide  reliable  information 
regarding  response  rates,  since  the  six-day  data  collection  period  was 
so  much  shorter  than  the  six -week  period  planned  for  the  main  data 
collection  effort.  The  guiding  philosophy  during  the  pretest  was  to 
complete  as  many  interviews  as  possible  within  a  tightly  constrained 
time  frame.  Therefore,  unlike  the  main  data  collection  effort,  no 
systematic  attempt  was  made  to  follow  up  on  all  telephone  numbers  to 
contact  breakoff,  eligible  respondents  who  were  not  immediately  acces¬ 
sible,  etc.  nor  was  there  any  refusal-conversion  effort.  However, 
preliminary  information  about  first  refusal  rates,  eligibility  rates 
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(households  screened  to  eligible  youth  identified) ,  and  reason  for 
ineligibility  among  16-  to  24-year-old  youths  were  obtained. 

Training  Interviewers  to  Conduct  the  Pretest 

Eleven  experienced  CATI  interviewers  were  trained  to  conduct  the 
pretest  for  ACOMS.  Trainers  from  the  Telephone  Research  Center  (TRC) 
and  ACOMS  project  staff  conducted  the  training,  which  spanned  a  six- 
day  period:  September  15  through  September  20,  1986.  Each  inter¬ 
viewer  had  a  total  of  28  hours  of  training  that  included  20  hours  of 
instruction,  4  hours  of  practice,  and  4  hours  of  home  study. 

Instruction  was  carried  out  at  Westat's  Rockville,  MD,  facility, 
where  a  large  conference  room  was  set  up  to  accommodate  the  training. 
Trainees  sat  at  individual  computer  terminals  at  which  they  could 
learn  by  working  with  the  CATI  program  while  they  received  instruction 
and  demonstration  from  the  trainers. 

Because  only  experienced  interviewers  were  used  for  the  pretest, 
there  was  no  need  to  provide  training  on  general  interviewing  skills 
and  the  use  of  the  CATI  equipment.  All  training  consisted  of  ACOMS - 
specific  material.  Specifically,  the  goals  of  the  pretest  training 
were : 

(1)  To  introduce  the  study  by  describing  its  objectives, 
the  method  for  respondent  selection,  and  characteris¬ 
tics  of  qualified  respondents; 

(2)  To  introduce  the  questionnaires  to  the  trainees,  their 
contents  and  skip  patterns,  question  specifications, 
definitions,  and  intent; 

(3)  To  distribute  written  training  materials  and  provide 
guidance  on  how  to  use  the  training  manual  as  a  refer¬ 
ence  during  interviewing;  and 

(4)  To  provide  instruction  and  practice  in  procedures 
specific  to  the  ACOMS  project,  such  as  probing  unclear 
responses,  answering  respondent  questions,  unusual 
recording  techniques,  and  refusal -avoidance. 

Figure  17  illustrates  the  ACOMS  Interviewer  Training  Agenda  for 
the  pretest.  In  general,  the  training  sessions  consisted  of  a  combi¬ 
nation  of  lectures,  demonstrations,  role  plays,  and  practice  on  indi¬ 
vidual  CATI  terminals.  During  the  training,  screens  from  a  "lead 
terminal,"  operated  by  a  trainer,  were  projected  out  so  that  trainees 
could  assess  their  progress  on  their  individual  terminals.  Throughout 
the  sessions,  trainees  were  monitored  closely  by  the  staff  in  the 
Telephone  Research  Center  and  by  project  staff. 

Extensive  training  was  provided  on  each  of  the  three  question¬ 
naires,  the  household  screener,  the  youth  interview,  and  the  parental 
interview.  In  addition  to  the  group  instruction,  trainees  had  four 
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ACOHS  -  INTERVIEWER  TRAINING  AGENDA 


DAY  1  -  MONDAY .  SEPTEMBER  IS,  1986 


1 

1 

1 

!  TIME 

1 

1 

1 

« 

t 

1 

•  TOPIC 

1 

« 

1 

TYPE 

SESSION 

|  MATERIALS 

PREPARED  BY 

i  PRESENTED  BY 

1 

< 

1 

1  6:00-6:20 

1 

1 

1 

• 

1 

1 

1 

S  Introduction  and  Study 
{  Background 

> 

i 

Planary 

]  -  Lactura  Script 

H .  Rhoads 

M.  Rhoads 

1 

1  6:20-8:00 

i 

i 

i 

i 

i 

1 

|  Intar act iva  Lactura  on 

2  Scraanar  and  Rasult 

2  Coda  Scraana 

Planary 

j  -  Intaractlva  Script 
j  -  Terminal  with 

J  Projector 

2  D.  Blttnar 
{  P.  Sklnnar 

2  P.  Sklnnar 

j  8:00-8: *5 

j  BREAK 

i  8:15-9:30 

i 

i 

1 

|  Intaractlva  Lactura 

|  (continuad) 

,•  9:30-10:00 

i 

t 

i 

i 

J  Raviav  and  Discussion 
]  of  Scraanar 

• 

Planary 

DAY  2  -  TUESDAY.  SEPTEMBER  16.  1986 

t 

t 

1 

i  TIME 

1 

» 

8 

i  TOPIC 

TYPE 

SESSION 

MATERIALS 

PREPARED  BY 

PRESENTED  BY  j 

1 

1 

1 

;  A  HOURS 

1 

1 

1 

1 

1 

1 

1 

!  Practice  on  Scraanar 
!  Quastlonnalra 

Individual 

2  -  Local  Talaphona 
{  N  unbars 

C.  Thonpaon 

All  j 

DAY  3  -  WEDNESDAY.  SEPTEMBER  17.  1986 

TIME 

TOPIC 

TYPE 

SESSION 

MATERIALS 

PREPARED  BY 

1 

1 

• 

PRESENTED  BY  i 

1 

1 

• 

6:00  -  7:00 

Ravi aw  of  Scraanar 
Practlea 

Rafuaal  Avoldanca 

Planary 

-  An s wars  to 

Raspondant  Quest. 

D.  Morgan 

• 

1 

0.  Morgan  2 

7:00  -  8:15 

Salaction  of  Raspondant 
(HHCHOOSK) 

Planary 

-  Intaractlva  Script 
Taralnal  with 
Projactor 

D.  Blttnar 

P.  Sklnnar 

D.  Blttnar  2 

« 

• 

i 

• 

8:15  •  8:30 

BREAK 

i 

i 

• 

8:30  -  10:00 

Intaractlva  Lactura 

Youth  Intarvlav 

Planary 

-  Interview  Script 
Terainel  with 
Projactor 

S.  Engle hart 

S.  Eng lehart  J 

« 

1 

r 

i 

i 

i 

i 

i 

( 

i 

« 

Figure  17.  ACOMS  pretest  interviewer  training  agenda. 
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ACOHS  -  INTERVIEWER  TRAINING  AGENDA 


DAY  A  -  THURSDAY.  SEPTEMBER  1R.  1986 


TIME 

TOPIC 

TYPE 

SESSION 

MATERIALS 

PREPARED  BY 

PRESENTED  BY  j 

6:00  -  8:30 

Intaractlve  Lactura 
Youth/Parent  Interviews 

Plenary 

■  Interactive  Script 
Terminal  with 
Projector 

S.  Englshart 

S.  Englehart  | 

8:30  -  8:45 

BIEAK 

8:45  -  10:00 

Co— unity /Youth 

Interview 

Cn— unity 

*  Co— unity  Script 
Taralnal  with 
Projactor 

L.  Kell 

1..  Kell 

DAY  5  -  SEPTEMBER  20.  1986 


!  TIME 

TOPIC 

TYPE 

SESSION 

MATERIALS 

PREPARED  BY 

PRESENTED  BY  ‘ 

|9:00  •  10:00 

Co— mlty  #2 

Youth 

Coa—nlty 

-  Cj— unity  Script 
( Probing ,  Unusual 
Recording) 

Le  Kail 
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Figure  17.  ACOMS  pretest  interviewer  training  agenda  (continued) 
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Training  began  with  a  brief  introduction  and  overview  of  the 
study.  A  relatively  long  period  was  then  devoted  to  screener  training 
and  practice  to  familiarize  trainees  with  the  questions  contained  in 
the  screener,  to  demonstrate  the  computer  process  for  selecting  eligi¬ 
ble  respondents,  and  to  discuss  the  methods  for  handling  nonresiden- 
tial  and  nonworking  numbers.  During  this  time,  trainees  were 
instructed  in  refusal -avoidance  methods  designed  to  keep  respondents 
on  the  line. 

Training  on  the  youth  and  parental  interviews  focused  on  the 
question-by-question  specifications  for  each  item  in  the  question¬ 
naire.  Trainees  were  encouraged  to  ask  questions  about  term  defini¬ 
tions,  appropriate  probing  of  responses,  and  potential  problems  they 
anticipated. 

Trainers  worked  from  a  series  of  scripts  that  had  been  developed 
to  demonstrate  various  skip  patterns,  recording  issues,  and  potential 
problems  in  the  ACOMS  interviews.  Three  types  of  pre- scripted  inter¬ 
views  were  used  during  the  training:  interactive  scripts,  community 
scripts,  and  role  play  scripts.  Interactive  scripts  were  the  simplest 
of  the  three,  designed  to  show  trainees  the  main  questions  in  the 
interview  without  any  problematic  or  unusual  responses.  These  scripts 
were  used  during  instruction  on  question-by- question  specifications. 

In  the  community  scripts,  the  trainer  took  the  respondent's  role 
and  called  on  trainees  to  act  as  interviewers .  These  scripts  were 
administered  in  small  groups,  hence  the  reference  to  "community". 

These  scripts  were  designed  to  demonstrate  specific  skip  patterns  and 
problem  areas,  to  reinforce  CATI  conventions  and  project  definitions 
introduced  earlier,  and  to  give  trainees  practice  answering  respon¬ 
dents'  questions. 

On  the  final  day  of  training,  trainees  worked  in  pairs  with  role- 
play  scripts.  One  member  of  the  pair  acted  as  the  interviewer  and  the 
second  member  acted  as  the  respondent.  Role-play  script  booklets  were 
provided  in  which  all  responses  were  predetermined  for  the  respondent. 
Trainees  were  instructed  to  follow  the  scripts  without  deviation  in 
order  to  provide  a  standard  experience  to  all  trainees  and  to  rein¬ 
force  probing  and  problem-handling  techniques  introduced  during  the 
instruction  portion  of  the  training.  Each  pair  of  trainees  received  a 
total  of  four  role-play  scripts,  one  parental  and  three  youth  inter¬ 
views.  They  took  turns  acting  as  interviewer  so  that  each  trainee  had 
the  opportunity  to  conduct  two  complete  interviews  during  this  portion 
of  the  training. 

In  addition  to  group  instruction,  trainees  also  practiced  admin¬ 
istering  household  screeners  on  local  telephone  numbers.  Each  trainee 
was  required  to  practice  for  four  hours. 


In  summary,  the  pretest  interviewer  training  consisted  of  exten¬ 
sive  instruction  and  practice  on  the  household  screener,  youth,  and 
parental  interviews.  Instruction  included  demonstration  of  correct 
coding  techniques,  discussion  of  question-by-question  specifications, 
project  definitions,  potential  problems,  and  likely  respondent  ques¬ 
tions.  Throughout  the  training  sessions,  the  trainees'  performance 
was  heavily  monitored  by  Telephone  Research  Center  and  project  staff. 
At  the  end  of  the  training  period,  the  staff  was  confident  that  the 
trainees  had  a  thorough  understanding  of  the  survey  to  be  conducted. 
The  trainees  were  told  that  they  would  attend  a  debriefing  session 
following  the  pretest  and  were  asked  to  keep  track  of  any  problems 
they  encountered  during  the  course  of  their  work  on  the  pretest. 

Training  Materials 

Written  materials  were  provided  for  the  trainees '  use  during  the 
training  itself  and  as  reference  tools  during  the  interview  process. 
The  written  materials  included  the  interviewer  training  manual,  a 
reference  list  of  the  questionnaire  modules,  a  magazine  list,  and  a 
list  of  likely  respondent  questions  coupled  with  desirable  answers. 

The  interviewer  training  manual .  The  ACOMS  pretest  training 
manual  consisted  of  two  main  parts:  (a)  general  discussion  of  the 
study,  and  (b)  the  question-by-question  specifications  for  the  survey. 

Figure  18  is  a  copy  of  the  Table  of  Contents  for  the  ACOMS 
pretest  training  manual.  It  lists  the  contents  of  the  seven  chapters 
that  introduce  the  study.  The  main  purposes  of  these  chapters  were  to 
introduce  the  study's  main  objectives,  to  describe  sample  selection, 
to  discuss  problems  that  might  be  encountered  by  interviewers,  and  to 
provide  a  brief  overview  of  the  survey  instrument. 

An  appendix  containing  illustrations  of  all  of  the  screens  in  the 
CATI  program  followed  the  introductory  material.  Accompanying  the 
screen  illustrations  were  explanations  of  when  the  screens  would 
appear  (i.e.,  skip  patterns),  definitions  for  project  purposes,  house¬ 
hold,  principal  wage  earner,  education  levels,  etc.,  and  clarifica¬ 
tions  for  questions  that  could  be  misunderstood  or  answered  ambigu¬ 
ously.  One  example  of  possible  ambiguity  is  the  question,  "What  is 
the  highest  grade  or  level  of  schooling  that  you  have  completed  and 
received  credit  for?"  Respondents  often  answer  this  question  by 
giving  their  current  educational  status  (e.g.,  "I  am  a  college  sopho¬ 
more.")  Text  accompanying  this  question  instructed  interviewers  to 
attend  to  the  underlined  words  in  the  question  and  to  probe  the 
respondent's  answer  by  verifying  that  he/she  has  completed  and 
received  credit  for  his/her  first  year  of  college.  Additionally, 
interviewers  were  instructed  to  probe  whether  the  respondent  attended 
a  two-  or  four-year  college.  Specification  of  question- intent  is 
necessary  to  ensure  that  interviewers  probe  and  code  respondents' 
answers  as  intended  by  the  questionnaire  designers. 
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manual,  three  other  types  of  reference  materials  were  provided: 


‘g 


(1)  Module  list:  The  16  unique  modules  contained  in  the 
three  questionnaires  were  listed  by  name  and  reference 
letters  such  as  Social  Influence  (SI).  A  brief 
description  of  the  module's  contents  was  also  provided. 
The  list  was  intended  to  be  used  as  an  easy  reference 
tool  by  interviewers  to  help  them  become  familiar  with 
the  various  sections  of  the  survey  instrument  and  their 
purposes.  The  complete  list  was  included  in  the  train¬ 
ing  manual  and  was  also  provided  on  a  separate  page  for 
easy  reference. 

(2)  Respondents'  question  list:  A  two-page  list  of  antici¬ 
pated  respondent  questions  was  also  provided  along  with 
suggested  answers  for  each.  It  was  included  in  the 
training  manual  as  well  as  on  separate  cards  for  easy 
reference  while  interviewing. 

(3)  Magazine  list:  A  magazine  list  was  provided  for  use  in 
the  Media  Habits  module,  in  which  respondents  are  asked 
to  name  the  magazines  they  read  on  a  regular  basis. 

The  magazine  list  provides  an  extensive  enumeration  of 
popular  magazines  paired  with  three-digit  code  numbers 
for  interviewers'  use  in  recording  respondents' 
answers.  The  magazines  were  listed  alphabetically. 
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Pretest  Administration 

The  pretest  was  conducted  from  September  22  through  October  1 , 
1986,  at  Westat's  Frederick,  MD  facility.  All  11  interviewers  trained 
for  the  ACOMS  pretest  participated  in  its  administration.  Their  hours 
were  scheduled  in  such  a  way  that  the  heaviest  staffing  occurred  in 
the  late  afternoons  and  early  evenings  and  on  weekends . 

While  the  pretest  interviews  were  being  conducted,  the  inter¬ 
viewers  were  heavily  monitored  by  representatives  of  the  telephone 
supervisory  staff,  questionnaire  design  staff,  CATI  programming  staff, 
and  the  Contracting  Officer's  Representative  (COR).  Each  of  these 
monitoring  groups  had  a  different  perspective. 

Supervisory  staff  at  the  TRC  focused  on  the  adequacy  of  the 
preparation  interviewers  had  received  during  training  and  the  useful¬ 
ness  of  the  training  materials.  They  also  noted  problems  interviewers 
encountered  in  following  instructions  in  the  questionnaire  and  in  the 
manual . 

The  CATI  programming  staff  monitored  the  pretest  administration 
to  test  the  accuracy  and  workability  of  programming  developed  for  the 
ACOMS  interview.  Errors  were  corrected  as  soon  as  they  were 
discovered . 
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Finally,  project  staff  who  had  developed  the  questionnaire  evalu¬ 
ated  the  adequacy  of  the  questionnaire  in  terms  of  apparent  comprehen¬ 
sibility  of  items  to  the  respondent,  unanticipated  sensitivity  of 
questions,  appropriateness  of  item  placement  in  terms  of  interview 
flow,  item  format,  and  the  suitability  of  questionnaire  items  to  meet 
survey  ob j e  c  t i ve  s . 


After  the  pretest  data  collection  was  completed,  a  debriefing 
session  was  held  that  included  the  pretest  interviewers  and  supervi¬ 
sors  as  well  as  project  and  training  staff.  Interviewers  were  asked 
to  discuss  any  problems  they  encountered  during  the  pretest  and  to 
make  suggestions  for  improving  the  flow  of  the  interview. 


Pretest  Results 


The  pretest  went  very  smoothly.  The  goal  of  the  pretest  was  to 
obtain  100  completed  interviews.  The  actual  number  completed  was  98. 


Pretest  results  can  be  divided  into  quantitative  and  qualitative 
information.  Quantitative  information  obtained  included  eligibility 
and  refusal-rates  and  administration  times  for  the  questionnaires  and 
modules.  Qualitative  information  included  insights  obtained  by 
pretest  monitoring  and  by  interviewer  debriefing. 


Questionnaire  Administration 


Household  identification.  Table  17  summarizes  the  outcome  of  all 
household  screener  calls  attempted  during  the  pretest.  A  total  of 
3,890  telephone  numbers  were  dialed.  The  calls  resulted  in  the  iden¬ 
tification  of  1,531  (39%)  households,  which  was  in  the  expected  range. 
More  than  1,000  calls  remained  incomplete  at  the  end  of  the  pretest 
because  little  effort  was  made  to  follow  up  on  calls  that  did  not 
result  in  contact  on  the  initial  attempt.  The  majority  of  incomplete 
calls  were  thought  to  be  unanswered  calls  made  to  businesses  during 
evening  hours  and  to  homes  during  the  day. 


Refusal  rates.  Refusals  can  occur  during  the  household  screener, 
or  during  the  main  youth  and  parental  interviews .  During  this 
pretest,  the  screener  refusal  rate  was  23.9%,  the  youth  refusal  rate 
was  6.9%,  and  the  parental  refusal  rate  was  15.7%. 


These  findings  are  viewed  with  cautious  optimism  on  the  basis  of 
two  important  factors.  First,  no  refusal-conversion  efforts  were  made 
during  the  pretest.  Typically,  at  least  one-third  of  all  refusals  are 
converted  to  completed  interviews.  Second,  following  the  pretest, 
changes  to  the  household  screener  were  made,  based  on  concerns  regard¬ 
ing  the  length  and  wording  of  the  introduction  and  question  order.  We 
anticipate  that  refusal -conversion  efforts  and  changes  in  the  screener 
will  combine  to  reduce  the  refusal -rate  so  that  an  overall  80% 
response  rate  will  be  obtained  during  actual  AC0MS  interviewing. 
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Table  17 


ACOMS  Pretest:  Household  Screener  Status 


Number 

Percentage 

Total  telephone  numbers  dialed 

3,890 

100.0 

Households  screened 

1,129 

29.0 

Household  refusals 

367 

9.4 

Households  with  language  problems 

35 

.9 

Out-of-Scope  (e.g.,  nonresidential) 

1,170 

30.1 

Incomplete  calls  (e.g.,  no  answers) 

1,189 

30.6 

Eligibility  rates.  In  Westat's  ACOMS  proposal  it  was  estimated 
that  approximately  seven  households  would  be  needed  to  identify  each 
Primary  Male  Sample  (PMS) ,  given  a  20%  nonresponse  rate.  For  a 
combined  PMS  and  Secondary  Male  Sample  (SMS),  the  screening  ratio  was 
estimated  to  be  6 . 7 .  It  was  not  anticipated  that  additional  screening 
would  be  necessary  to  identify  female  eligibles. 

During  the  pretest,  156  eligible  males  were  identified  from  1,129 
households  screened.  This  represents  an  eligibility  rate  of  approxi¬ 
mately  7.2  households  to  1  eligible  male  youth,  somewhat  higher  than 
the  estimated  6.7:1  ratio.  These  findings  are  regarded  with  concern 
but  not  alarm.  It  is  likely  that  finalizing  incomplete  calls  and 
refusal -conversion  efforts  will  bring  the  eligibility  rate  to  the 
estimated  level.  Careful  attention,  however,  will  be  paid  to  the 
eligibility  rate  during  the  first  months  of  data  collection  for  ACOMS, 
so  that  revisions  can  be  made,  if  necessary,  to  the  estimated  number 
of  household  screeners  needed. 

Administration  times.  Table  18  summarizes  the  eligibility  status 
of  youth  and  parent  identified  during  the  screener  pretest.  The  aver¬ 
age  completion  time  for  household  screeners  was  4.3  minutes.  The 
estimate  included  in  the  Office  of  Management  and  Budget  (0MB)  package 
was  three  minutes.  Changes  in  the  screener  to  be  discussed  later  in 
this  chapter  are  expected  to  reduce  the  average  time  of  screener 
completion  to  the  0MB  estimate. 

Average  completion  time  for  the  youth  interview  was  33.3  minutes, 
which  is  very  close  to  the  estimated  30  minutes  included  in  the  0MB 
package.  It  is  anticipated  that  recommended  changes  in  the  instru¬ 
ment,  coupled  with  increasing  efficiency  of  interviewers  as  they  gain 
experience  with  the  questionnaire,  will  reduce  the  administration  time 
for  the  youth  interview  to  the  0MB  estimate. 


VJ 

V  ’V  v  •/•.] 


Table  18 


ACOMS  Pretest:  Eligibility  of  Individuals  Identified 


Youth 

Male  Female 

Total 

Parents 

Father  Mother 

Total 

Youth 

Parent 

Total 

Eligible  for 
interview 

156 

31 

187 

23 

22 

45 

232 

Completed 

71 

11 

82 

9 

7 

16 

98 

Refusals 

5 

1 

6 

1 

2 

3 

9 

Incomplete 

80 

19 

99 

13 

13 

26 

125 

Ineligible 
for  interview 

42 

8 

50 

.. 

50 

Military 

service 

19 

3 

22 

22 

College 

graduates 

8 

5 

13 

-  - 

13 

Own  address 

8 

0 

8 

-- 

8 

DK/REF 

(Military) 

4 

0 

4 

-- 

-- 

4 

DK/REF 

Total 

3 

0 

3 

“  “ 

“  “ 

3 

identified 

198 

39 

237 

23 

22 

45 

232 
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Average  completion  time  for  the  parental  interview  was  23.9 
minutes,  well  below  the  estimate  of  30  minutes  made  in  the  0MB 
submission. 

Table  19  lists  the  mean  and  median  questionnaire  administration 
times  for  each  module  in  the  youth  and  parental  pretest  interviews. 
These  administration  times  will  be  monitored  continually  during  formal 
data  collection,  with  a  view  toward  the  possible  effects  of  quarterly 
alterations . 

Results  of  Monitoring  and  Interview  Debriefing  Sessions 


At  the  end  of  the  pretest,  a  debriefing  session  of  the  pretest 
interviewers  and  supervisors  was  held.  They  were  encouraged  to 
discuss  problems  that  occurred  during  the  pretest,  suggestions  for 
improving  interview  flow,  item  format,  and  any  other  ideas  that  might 
be  useful  in  increasing  the  effectiveness  of  the  ACOMS  data  collec¬ 
tion.  The  interviewers  and  supervisors  made  very  perceptive  comments 
which  demonstrated  a  high  level  of  involvement  and  concern  for  the 
study's  outcome.  It  was  encouraging  to  note  that  many  of  the  problems 
had  already  been  identified  by  project  staff  during  their  pretest 
monitoring  efforts,  and  most  problems  had  been  resolved.  The  complete 
list  of  issues  and  suggestions  was  carefully  reviewed,  and  lessons 
learned  were  noted  for  future  training  sessions  and  questionnaire 
revision.  The  findings  from  this  review  process  are  presented  in  the 
next  section  of  this  chapter. 

Lessons  Learned  and  Changes  Recommended 

This  section  summarizes  the  major  lessons  that  have  been  learned 
from  the  pretest.  High-priority  changes  required  prior  to  commence¬ 
ment  of  the  ACOMS  on  October  13,  1986,  have  been  instituted  in  close 
cooperation  with  the  COR  and  Special  Advisory  Group  (SAG) .  These 
changes,  and  additional  recommended  changes  that  have  not  yet  been 
made  are  presented  in  this  discussion. 

General  lessons  learned  about  interviewer  training  are  discussed 
first,  followed  by  scrutiny  of  the  questionnaires  (i.e.,  the  household 
screener  and  the  youth  and  parental  interviews).  In  most  cases, 
issues  involving  programming,  questionnaire  content,  administration, 
and  in  some  cases  specific  training  issues  are  raised  in  conjunction 
with  the  solutions  that  have  been  recommended. 

Interviewer  Training 


Interviewers,  supervisors,  and  project  staff  thought  the  inter¬ 
viewer  training  sessions  were  useful  and  comprehensive,  a  finding 
which  reflects  the  TRC's  considerable  experience  in  conducting  train¬ 
ing  sessions.  The  pretest  experience  has  resulted  in  well- trained 
interviewers  who  had  very  few  difficulties  with  the  mechanics  of  tve 
CATI  system  or  the  techniques  of  conducting  the  ACOMS  interviews. 
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Table  19 


Module  Administration  Times 


Youth 

Interview 

Parental 

Interview 

Mean 

time 

(minutes)  (minutes) 

Median 

time 

(minutes) 

Mean 

time 

(minutes) 

Median 

time 

1. 

Education  and  employment 

3.1 

3.3 

-- 

2. 

Intent ions/pr opens ity 

4.0 

4.0 

-- 

3. 

Behaviors 

1.8 

2.0 

-- 

-- 

4. 

Social  influences 

2.1 

2.0 

-- 

5. 

Importance  of  attributes 

2.2 

2.0 

2.3 

2.0 

6. 

Media  habits 

4.1 

4.0 

4 . 6 

4.0 

7. 

Knowledge  -  recall 

3.4 

3.0 

3.5 

4.0 

8. 

Attitudes  toward 

Army  ads 

0.6 

1.0 

0.9 

1.0 

9. 

Knowledge  -  slogan 
recognition 

1.5 

2.0 

10. 

Perceptions/beliefs 

5.0 

5.0 

5.7 

5.0 

11. 

Knowledge  -  awareness 

2.8 

3.0 

2.9 

3.0 

12. 

Demographic 

3.7 

3.0 

2.4 

2.0 

13. 

Parental  location 

2.1 

2.0 

14. 

Longitudinal  tracking 

3.9 

4.0 

-- 

15. 

Parental  influences 

-- 

-- 

5.3 

33.3 

32.5 

23.9 

24.0 

Note .  Total  administration  time  is  less  than  the  sum  of  the  times  for 
individual  modules  because  not  all  respondents  receive  all  modules. 
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Project  personnel,  however,  identified  possibilities  for  improve¬ 
ment  in  written  training  materials,  and  training  on  several  project- 
specific  issues.  All  of  the  recommended  changes  were  made  prior  to 
the  start  of  interviewer  training  for  the  main  study. 

Training  Materials 

Training  manual .  In  a  few  instances,  information  was  added  to 
the  training  manual  to  clarify  definitions.  For  example,  it  was  made 
explicit  that  persons  who  are  not  U.S.  citizens  are  eligible  for 
interview.  Also,  the  definition  of  residency  for  youth  whose  parents 
share  joint  custody  was  expanded.  It  was  specified  that  if  the  youth 
spends  an  unequal  amount  of  time  living  in  the  households  of  his/her 
father  and  mother,  the  household  of  residence  is  considered  to  be  the 
one  In  which  he/she  spends  the  most  time.  If,  on  the  other  hand,  the 
youth  divides  his/her  time  equally  between  the  father's  and  mother's 
households,  the  household  of  residence  is  considered  to  be  the  one  in 
which  he/she  currently  resides. 

Magazine  list.  To  facilitate  interviewer  coding  of  answers  to 
the  magazine  readership  question,  the  magazine  list  was  revised  in  two 
ways.  First,  the  alphabetical  list  of  titles  was  modified  so  that 
space  appeared  between  groups  of  titles  beginning  with  the  same 
letter.  Second,  duplicate  listings  of  the  17  most  popular  magazine 
titles  were  placed  at  the  top  of  the  page.  The  pretest  showed  that  a 
few  popular  magazines  accounted  for  the  majority  of  responses  to  the 
questions  about  regular  magazine  readership. 

Respondents'  question  list.  When  respondents  asked  questions 
about  the  study  (e.g.,  "Who  is  sponsoring  this  survey?"),  interviewers 
were  required  to  look  up  the  answers  on  the  Respondents '  Question 
List.  To  facilitate  this  process,  the  question  list  was  reorganized 
so  that  the  most  common  questions  were  listed  first.  The  questions 
were  also  separated  into  project-specific  questions  (e.g.,  "Who  is 
funding  the  study?")  and  general  information  (e.g.,  explanations  as  to 
how  the  respondent's  telephone  number  was  selected). 

Rotation  handout.  During  the  pretest  training,  rotation  of 
wording,  response  categories,  questions,  and  modules  was  allowed  to 
occur  as  it  would  during  actual  interviewing.  This  method  proved 
somewhat  confusing  to  the  trainees,  because  the  random  order  in  which 
many  of  the  questions  appeared  meant  that  the  questions  on  trainees' 
individual  terminal  screens  were  often  different  from  those  projected 
on  the  wall  screen  by  the  trainers.  This  fact  also  made  discussion  of 
specific  items  somewhat  difficult.  Consequently,  it  was  decided  to 
handle  the  topic  of  rotation  in  a  written  handout  rather  than  by 
demonstration.  During  interviewer  training  for  the  main  study,  rota¬ 
tion  did  not  occur;  instead,  the  topic  of  rotation  was  described  in  a 
handout.  This  practice  will  be  continued  for  all  future  ACOMS 
interviewer  training. 


A  need  for  additional  emphasis  or  alteration  in  training  instruc¬ 
tions  was  identified  for  two  general  areas:  spelling  verification  and 
recording  of  question  probes.  Interviewers  are  required  to  type  in 
some  information  during  the  survey,  such  as  first  names  of  youths  in 
each  household,  county  in  which  the  household  is  located,  and  names 
and  addresses  of  tracing  references.  Interviewers  are  trained  to 
verify  the  spelling  of  all  such  information,  including  even  the  most 
common  names.  Monitoring  of  interviewers  during  the  pretest  revealed 
that  regional  accents  often  made  it  difficult  for  interviewers  to 
understand  respondents  making  spelling  verification  difficult.  Thus, 
additional  spelling  verification  techniques  were  introduced,  such  as 
using  the  convention  of  alphabet  reinforcement  ("A  as  in  apple"  "B  as 
in  boy,"  etc.).  The  importance  of  spelling  accuracy  was  also 
stressed. 

Recording  of  question-probes  also  required  additional  training. 
During  the  pretest,  interviewers  displayed  some  inconsistency  in 
recording  probes.  Additional  training  emphasized  the  importance  of 
recording  all  probes  and  clarified  what  constitutes  a  probe  and  what 
does  not. 

Household  Screener 

Four  problem  areas  were  identified  in  the  household  screener. 

Each  of  these  is  discussed,  and  recommended  changes  are  described. 

Confidentiality  information.  The  first  and  most  important  prob¬ 
lem  in  the  household  screener  centered  around  the  provision  of  confi¬ 
dentiality  information.  During  the  pretest,  the  CONF  screen  provided 
the  confidentiality  information  shown  in  Figure  19. 


CONF 

The  survey  we  are  conducting  for  the  Federal  Government  is  concerned 
with  the  career  plans  of  young  adults.  Your  answers  are  voluntary  and 
will  be  completely  confidential. 

While  you  may  choose  not  to  answer  any  question,  the  information  you 
give  us  is  protected  under  the  Privacy  Act  of  1974.  Your  identity 
will  never  be  known  by  anyone  except  the  research  project  staff.  The 
information  you  give  us  will  be  used  for  research  purposes  only. 

This  research  is  authorized  by  law  in  Title  10  USC  Sections  503  and 
2358  and  Executive  Order  9397. 

[PRESS  RETURN  TO  CONTINUE] 


Figure  19.  Confidentiality  screen  for  ACOMS  household  screener. 


It  became  apparent  early  in  the  pretest  that  this  section  of  the 
screener  was  responsible  for  a  great  many  of  the  early  refusals  and 
interview  break-offs  that  occurred.  The  introduction  was  too  long  and 
some  of  the  language,  Federal  Government  and  Privacy  Act  citations, 
was  frightening  to  respondents.  Additionally,  interviewers  complained 
that  they  often  went  to  great  lengths  to  convince  respondents  to 
continue  with  the  survey,  only  to  find  in  the  very  next  question  that 
there  were  no  eligible  youths  living  in  the  household. 

Before  beginning  data  collection,  the  confidentiality  section  was 
streamlined  and  strengthened.  Citation  of  the  specific  Privacy  Act 
laws  was  moved  to  the  end  of  the  interview.  Thus,  if  no  household 
members  were  eligible  for  interview,  the  confidentiality  information 
and  the  Privacy  Act  would  be  cited  at  the  end  of  the  screener.  If 
interviews  were  actually  conducted,  the  confidentiality  information 
would  be  cited  at  the  end  of  the  main  interviews.  This  change  broke 
up  the  introductory  material  so  that  it  was  of  a  more  manageable 
length.  In  addition,  the  confidentiality  statements  were  strengthened 
by  adding  the  explicit  promise  that  the  individual's  name  will  not  be 
used  on  any  report  of  the  study.  Finally,  wording  and  question-order 
changes  were  instituted  in  the  interest  of  refusal-prevention. 

Order  of  questions  about  education.  The  education  questions  were 
reordered  and  new  CATI  checks  were  added  to  verify  educational  infor¬ 
mation  that  previously  appeared  obvious  from  the  respondents'  answers. 

Screener  respondent.  The  CATI  program  was  altered  to  facilitate 
the  interview  flow  from  screener  to  youth  interview,  when  the  screener 
respondent  was  an  eligible  youth. 

In  addition,  redundancy  in  the  question  about  the  youth's  educa¬ 
tional  background  was  removed.  It  is  anticipated  that  this  streamlin¬ 
ing  will  not  only  increase  the  likelihood  of  obtaining  completed 
interviews  from  screener  respondents  but  will  also  shorten  the  admin¬ 
istration  time. 

Undergraduate  student  housing.  The  question  on  undergraduate 
student  housing,  which  was  intended  to  identify  one  type  of  nonresi- 
dential  number,  caused  considerable  confusion  among  respondents. 

Given  the  low  probability  of  contacting  such  an  institution 
through  Random  Digit  Dialing  (RDD) ,  the  question  was  dropped.  How¬ 
ever,  interviewers  were  provided  additional  training  on  probing  and 
coding  undergraduate  student  housing  information.  This  change 
improved  the  flow  of  the  interview  and  shortened  the  time  for  screener 
administration. 

Youth  and  Parental  Interviews 

With  the  exception  of  the  Perceptions/Beliefs  module,  both  the 
youth  and  parental  interviews  were  very  smoothly  administered  during 
the  pretest.  The  questions  were  clearly  comprehensible  to  respondents 
and,  in  general,  were  well-received.  There  was  little  trouble  in 


obtaining  sensitive  information  such  as  Social  Security  number  and 
tracing  information  from  the  youth  interviewed.  Somewhat  greater 
resistance  was  encountered  in  dealing  with  parents,  but  in  most  cases, 
interviewers  were  able  to  overcome  parents'  objections  to  providing 
needed  information. 

The  most  important  problems  that  occurred  during  the  pretest  were 
with  the  Perceptions/Beliefs  module.  Some  of  these  problems  also  have 
implications  for  the  Importance  of  Attributes  module  because  questions 
in  the  two  sets  are  parallel.  Problems  with  the  Demographics  and 
Parental  Location  modules  were  also  encountered.  These  and  a  few 
additional  minor  difficulties  are  discussed  next,  along  with  the 
recommended  solutions . 

Perceptions/Beliefs  module.  Early  in  the  pretest,  problems 
became  apparent  in  the  Perceptions/Beliefs  section.  As  respondents 
answered  questions  within  this  module,  they  appeared  to  fall  into 
response  sets  which  resulted  in  very  little  variance  and  little 
differentiation  among  items.  Preliminary  analyses  were  conducted  to 
explore  the  seriousness  and  extent  of  the  response -set  problem. 

Typically,  the  Perceptions/Beliefs  module  begins  with  a  lengthy 
series  of  14  questions  about  the  attributes  of  the  active  Army.  This 
series  is  followed  by  a  rotating  second  list  that  varies  in  length 
from  8  to  14  questions  about  the  attributes  of  one  of  the  Army  compo¬ 
nents,  another  branch  of  the  military  service,  or  a  nonmilitary  option 
such  as  college.  For  some  respondents,  there  is  a  third  rotating 
series  referring  to  another  of  the  possible  referents  listed  above. 

All  of  the  questions  in  these  series  require  a  response  on  a  five- 
point  scale;  all  are  positively ^worded,  and  all  are  presented  in  a 
list-format  similar  to  that  for  the  active  Army. 

A  preliminary  check  on  the  severity  of  the  response -set  problem 
showed  that  34%  of  the  respondents  who  answered  the  active  Army  series 
(n-74)  used  the  same  response  category  for  9  or  more  of  their  answers. 
About  14%  answered  12  or  more  questions  with  the  same  response, 
suggesting  a  serious  response -set  problem.  Further  examination  showed 
that  among  the  34%  who  answered  9  or  more  active  Army  questions  with 
the  same  response  category,  the  majority  (80%)  of  the  identical 
responses  were  either  4  or  5  on  the  5 -point  scale.  This  positive  bias 
would  make  it  difficult  to  find  any  meaningful  distinction  among 
respondent  segments . 

Screen  format.  The  Perceptions/Belief  module  caused  difficulty 
for  interviewers  because  it  contained  a  long  list  of  items  that 
required  a  sealed  (i.e.,  "disagree"  to  "agree")  response.  (See  Figure 
20.)  Respondents  tended  to  become  bored  and  appeared  not  to  take 
these  questions  seriously.  A  quick  analysis  of  the  data  supported 
observations  of  response-set  problems. 

Temporary  solutions  have  been  implemented  in  training  methods 
that  will  allow  interviewers  to  maximize  the  likelihood  of  obtaining 
good  data  with  the  present  format.  In  general,  additional  emphasis 
was  given  to  these  modules  in  the  interviewer  training  to  improve 
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1  «.t.  going  :s  r*»a  you  a  list  or  staoamencs  oaacr  uing  bi  ff  s.-s.-.c 
things  the  Army  might  gravida  to  you.  Please  tall  ma  how  mucn  you 
disagree  or  agree  that  tha  Army  grovidai  you  with  aach  item  on  tha 
list.  A  *1"  naans  you  disagraa  completely,  a  “2“  maans 
you  disagraa  somawhat,  a  “T*  maans  you  naithar  agraa  nor  disagraa, 
a  '*4"  maans  you  agraa  somawhat  and  a  “5"  maans  you  agraa  completely- 

Tha  Army  offers  .  .  . 


an  axcallant  opportunity  to  obtain  nonay  for  a  collaga 
or  vocational  education? 

■an  opportunity  to  davalap  into  a  raapansibla  naturi  parson7 
■many  opportunities  far  training  in  ueeful  skill  areas? 

•many  chances  to  work  with  high-quality  people? 
a  wide  variety  of  opportunities  to  find  a  job  you  can  enjoy' 
a  physically  challenging  experience? 


11,001  PE1B 


tPlaase  tall  ma  how  much  vou  disaqrea  or  agraa  that  the  Armv  ;  ias 
you  with  each  item  on  tha  list.  A  "1"  maans  you  disagree 
comolataly  a  moans  you  disagraa  somewhat,  a  maans  vou  neither 

agree  nor  disagree,  a  "4"  maans  you  agraa  soaawhac  ana  a  "5"  moans  you 
agree  completely.! 

C Tha  Army  offers  ...  1 


’an  experience  you  can  be  proud  of? 

■an  advantage  over  going  right  from  high  school  to  college? 
■the  best  opportunity  to  develop  leadership  skills? 

■the  chance  to  work  with  sophisticated  high-tech  equipment? 
a  great  value  in  your  civilian  career  development? 
an  excellent  opportunity  to  develop  self-confidence? 
the  opportunity -to  develop  your  potential? 
a  mentally  challenging  experience? 


i 
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Figure  20.  Perceptions/Beliefs  module  in  parental  and  youth 
questionnaires. 


interviewer  involvement  with  this  module.  Also,  comparisons  among  the 
various  interviewers'  styles  and  their  corresponding  response  patterns 
to  these  questions  suggested  a  number  of  possible  areas  for  improving 
the  administration  of  questions  in  these  modules: 


(1)  Slow  down.  The  interviewers'  natural  tendency  to  counteract 
the  perceived  irritation  of  respondents  was  to  speed  up  and 
go  through  the  lists  as  quickly  as  possible.  The  opposite 
tactic  appeared  more  effective. 


Break  up  the  series.  Anything  that  could  be  done  to  break 
up  the  perception  of  a  long,  tedious  list  also  helped.  For 
example,  interviewers  who  repeated  the  phrase  "The  Army 
offers..."  at  several  points  during  the  list  of  attributes 
had  fewer  response -set  problems  than  those  who  read  the 
entire  list  straight  through  without  a  break. 


Refocus  respondents'  attention  on  proper  referent.  It  was 
observed  that,  at  times,  the  respondents  appeared  to  lose 
track  of  which  branch/component/option  was  referred  to  by 
the  questions.  It  was  agreed  that  interviewers  should  be 
trained  to  emphasize  the  referent  when  reading  the  introduc¬ 
tion  to  a  series  of  questions  and  to  repeat  the  phrase  "The 
Army  (or  branch/component/option)  offers..."  halfway  through 
the  list  of  questions  on  each  screen.  This  process  was 
aided  by  mentioning  the  referent  in  the  introduction  to  each 


series . 


In  addition,  the  question  format  will  be  changed  for  future  data 
collection.  The  questions  on  Importance  of  Attributes  and 
Perceptions/Beliefs  will  be  paired  together,  attribute  by  attribute 
(e.g.,  "How  important  is...?"  followed  by  "Does  the  Army  offer  ...?" 
followed  by  "Does  the  Navy  offer...?"),  instead  of  presenting  each 
list  separately.  Small-scale  tests  have  indicated  that  this  format 
relieves  the  monotony  significantly. 


Word  problems.  It  also  became  apparent  that  the  wording  of  ques¬ 
tions  in  the  Perceptions/Beliefs  and  Importance  of  Attributes  modules 
was  problematic.  Specifically,  in  some  cases  respondents  did  not 
understand  words  used  in  the  questions  (e.g.,  innovative)  or  were 
offended  by  the  wording  (e.g.,  "...an  opportunity  to  develop  into  a 
mature  and  responsible  person").  Additionally,  respondents'  answers 
were  sometimes  ambiguous  because  of  the  wording  of  the  questions.  For 
example,  disagreement  with  the  statement,  "The  Army  offers  the  best 
opportunity  to  develop  leadership  skills,"  could  mean  that  the  respon¬ 
dent  does  not  think  the  Army  offers  an  opportunity  to  develop  leader¬ 
ship  skills  or  it  could  mean  the  respondent  disagrees  with  the  idea 
that  the  Army  offers  the  best  such  opportunity. 


In  consultation  with  the  COR  and  SAG  members,  four  questions  were 
reworded  in  both  the  Importance  of  Attributes  and  the  Perceptions/ 
Beliefs  sections  prior  to  the  start  of  data  collection  for  the  main 
ACOMS  study. 


Demographics  module.  The  demographics  questions  about  parents  in 
the  household  were  difficult  to  administer  in  nontraditional  house¬ 
holds.  In  nontraditional  households,  the  head  of  household  may  be  a 
stepparent  rather  than  a  natural  parent.  In  the  pretest,  questions  in 
this  series  referred  to  "father"  or  "mother."  This  reference  pre¬ 
sented  a  problem  if  the  natural  parent  lived  outside  the  household 
because  it  was  sometimes  unclear  whether  the  information  gathered 
referred  to  the  natural  or  stepparent. 

The  short-term  solution  to  the  problem  with  the  Demographics 
module  was  additional  training  to  clarify  the  information  desired  from 
the  Demographics  questions.  Since  this  series  is  important  for  estab¬ 
lishing  the  socio-economic  level  of  the  household,  the  education  and 
employment  status  of  the  head  of  the  respondent's  household  is  the 
information  needed.  If  the  respondent  lives  in  a  traditional  house¬ 
hold,  this  information  is  adequately  obtained  by  asking  the  series  of 
questions  about  father's  and  mother's  education  and  employment  status 
as  currently  written.  However,  if  the  respondent's  household  is  not  a 
traditional  one ,  interviewers  were  trained  to  probe  for  and  then 
remember  whether  a  stepparent  lives  in  the  household.  If  so,  the 
education  and  employment  series  should  refer  to  this  person,  not  to 
the  youth's  natural  parent. 

A  long-term  solution  is  also  recommended  for  the  second  quarter 
of  data  collection.  Specifically,  it  is  recommended  that  the  ques¬ 
tionnaire  be  changed  so  that  the  youth  is  directly  asked  whether 
he/she  lives  with  his/her  parents  or  stepparents.  Then,  subsequent 
education  and  employment  questions  should  refer  to  the  appropriate 
person  (i.e.,  parent  or  stepparent). 

Parental  location  module.  Confusion  also  occurred  in  obtaining 
parental  location  information  for  youths  who  had  nontraditionally 
structured  families.  If  the  youth  has  lived  most  of  his/her  life  with 
a  stepparent,  then  it  may  be  this  individual  rather  than  his/her 
natural  parent  who  has  the  most  influence  on  the  youth's  career 
decisions . 

Again,  training  was  modified  for  a  short-term  solution;  eventu¬ 
ally,  a  change  in  the  questionnaire  is  recommended.  Thus,  prior  to 
the  start  of  the  main  study,  if  a  nontraditional  situation  exists, 
interviewers  were  trained  to  ask  whether  the  parent  or  stepparent  is 
more  influential.  The  long-term  solution  to  this  problem  requires  a 
questionnaire  change  and  system  reprogramming.  If  a  stepparent  lives 
in  the  youth's  household,  the  respondent  will  be  asked  who  is  more 
influential,  the  natural  or  stepparent.  Thereafter,  questions  would 
refer  to  the  appropriate  parental  influence. 

Other  modules.  A  few  minor  problems  with  some  of  the  other 
modules  are  also  noteworthy.  The  pretest  showed  that  the  questions 
concerning  television  viewing  in  the  Media  Habits  module  did  not 
clearly  differentiate  subscription  cable  channels  (e.g.,  Home  Box 
Office)  from  nonsubscription  cable  channels.  The  reference  to  cable 
TV  channels  will  differentiate  between  subscription  and  nonsubscrip¬ 
tion  cable  channels. 


In  addition,  the  response  categories  for  questions  regarding  high 
school  mathematics  courses  (EE- 9  through  EE- 12)  were  expanded  to 
include  "currently  taking  the  course." 

Summary  of  Pretest 

The  pretest  for  ACOMS  successfully  served  the  functions  of  test¬ 
ing  the  training  methods  and  CATI  programming  as  well  as  answering 
questions  about  the  questionnaire  content  (e.g.,  item  formatting)  and 
questionnaire  administration  (e.g.,  administration  times).  In 
general,  the  pretest  demonstrated  that  the  intensive  design  efforts  by 
Westat,  The  U.S.  Army  Research  Institute  and  the  SAG  over  the  past 
year  have  resulted  in  a  very  workable,  clear,  survey  instrument.  The 
number  of  problems  identified  is  small,  considering  the  length  and 
complexity  of  the  instrument. 


The  pretest  was  important,  however,  in  pointing  out  problems  that 
must  be  rectified  with  the  screener  and  with  particular  modules  of  the 
youth  and  parental  interviews.  Correcting  problems  in  the  length  and 
wording  of  the  household  screener  introduction  promises  to  increase 
the  response  rate  and  interviewers'  ease  of  administration.  By  modi¬ 
fying  specific  problem  modules  and  altering  screens  and/or  training 
before  starting  data  collection,  the  quality  of  information  gathered 
in  the  ACOMS  survey  will  improve.  Additionally,  areas  targeted  for 
improvement  by  the  start  of  the  second  quarter  of  data  collection  have 
also  been  clearly  identified  by  pretest  results. 
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Maroa  4,  1536 


Subject:  ACC  MS  Sample  Dcaign-Esa  mated  Effect  of  Excluding  Puerto  Rico  from 

ACC  MS  Urnvese  on  the  Tool  Screening  Effort  far  ACOMS  Sample 
Components 

la  tbe  two  recent  sample  design  memos,  dated  February  21  and  26,  we  discussed 
alternative  universes  of  counties  for  the  ACOMS  Hispanic  sample  and  tbe  effect  of  excluding 
graduate  students  from  die  four-year  college  students  sample.  In  tbe  Hispanic  nww  we  provided 
four  alternative  universes  with  coverages  ranging  from  75  to  30  percent  of  ail  Hispamcs  ui  me 
United  States  when  Puerto  Rico  is  excluded.  and  79  to  33  petan  when  Puerto  Rico  is  induced 
in  the  ACOMS  universe.  In  the  four-year  college  memo,  we  mar  a  screening  samoie  of 

about  134,000  is  accessary  to  produce  2400,  PMS.  four-year  college  undergraduate  smoents. 
The  purpose  of  this  memo  is  to  annate  the  total  screening  far  ACOMS  sample  components 
based  an  the  above  findings.  The  sample  components  here  do  not  include  the  Vo-Tech 

sample.  We  plan  to  sample  Vo-Tech  students  from  a  list  of  Vo-Tech  schools.  We  will  also 
discuss  the  effects  of  excluding  Puerto  Rico  from  the  ACOMS  universe  on  tbe  Hispanic  sample 
and  tbe  tool  screening  effort. 

Note  that  it  would  require  almost  doubling  the  amount  of  screening,  wnnmM  for  the 
PMS  sample  (about  70,000),  to  achieve  the  repaired  sample  size  for  the  four-year  college 
students.  An  alternative  way  of  ovmampling  four-year  college  indents  is  to  use  a  two-stage 
sampling  scheme  to  select  a  sample  of  underyarinam  smrtrna  from  a  list  of  four-year  colleges. 
This  method  will  emminne  a  dnal-ftame  approach  with  pm  rf  the  sampig  p-r.mw  ppp 

sample  and  part  selected  by  gomg  to  a  sample  of  four-year  colleges.  Tin  list  approach.  similar  iq 
the  one  proposed  for  the  VoTech  sample,  involves  some  problems  that  haw  to  be  wotted  out 
(Le..  sane  schools  will  probably  refuse  to  cooperate,  a  forty  large  period  of  time,  probably  3  to 
4  months,  is  necessary  to  negotiate  with  school  officials).  The  following  two  sections  provide 
anmarea  of  screening  workload  for  the  two  approaches  available  for  oversampling  four-year 
college  students.  The  first  section  provides  a  tuna  res  of  screening  effort  when  RDD  is  used  to 
ovenampie  four-yen  college  students.  The  anmaaad  goal  screening  effort  whec  a  list  sample  is 
used  to  ovenaapie  four-year  college  students  is  given  in  Section  2.  Secrm  3  includes  a 
discussion  of  the  effects  of  excluding  Puerto  Rico  from  the  universe  on  the  structure  of  the 
Hispanic  sample. 
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We  expeg  that  a  self-weighting  screening  sample  of  124,000  households  which  includes 
Puerto  Rico  will  yield  a  sample  of  about  1,230.  .VPS,  Hispanic  mai«x  15.24  yean  of  age. 
However,  only  a  portion  of  the  1.230  Hispamcs  will  come  from  the  specific  geograpnie- areas 
******  as  the  ACOMS  Hispanic  universe  and.  thus,  can  be  included  in  tbe  Hispanic  tabulations 
The  actual  size  of  this  sample  wtil  depend  on  the  universe  to  be  seiened  fa  Hispamcs.  and 
whether  Puerto  Rico  will  be  pan  of  the  universe.  Table  l  shows  the  ipprexnnate  sample  sizes 
available  from  134,000  screened  households  fa  the  four  altsnaave  universes  m 

memo  of  February  21. 
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The  screening  sample  of  124.000  must  be  increased  to  provide  the  additional  Hisoamcs 
needed  to  acaieve  the  desired  preeaioa.  For  the  four  opnona  sated  m  the  taole.  ir.e  total 
screening  effort  for  ACOMS  sample  components  is  estimated  to  be  around  130.000  if  Puerto 
Rico  is  part  of  the  universe.  The  exclusion  of  Puerto  Rico  will  increase  tne  screening  woncioao 
by  aoour  13,000.  The  total  screening  effort  for  ACOMS  sample  components  wul  then  oe  in  tne 
nesgnbornood  of  168,000  when  Puerto  Rico  is  ctriurifri  from  the  umvme. 
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This  approach  uses  a  list  of  four- year  colleges  to  ovenample  four-year  college  students. 
Therefore,  the  sue  of  the  screening  sample  (as  estimated  for  the  PMS)  will  be  about  70.000. 
Table  2  provides  the  approximate  Hispanic  sample  sues  available  from  70.000  screened 
households  for  the  four  alternative  Hispanic  universes. 

An  screening  sample  of  about  44,000  households  is  requited  to  produce  tne 

sample  sues  needed  for  Hispanics  when  Puerto  Rico  is  not  pan  of  the  universe.  When  Puerto 
Rico  is  pan  of  the  universe,  die  additional  screening  for  oversampling  Hispanics  will  be  aoout 
24.300.  That  is.  the  total  screening  effort  for  ACOMS  sample  components  is  about  L  14.000 
when  Puerto  Rico  is  pan  of  the  universe,  and  about  94.300  when  Puerto  Rico  is  not  pan  of  the 
universe. 


Furthermore,  the  exclusion  of  Puerto  Rico  from  the  universe  will  affect  the  structure  of 
the  Hispanic  sample  with  inspect  to  the  Hispanic  dmriaon,  When  Puerto  Rico  is  mrh.ri.Ti  m  •r.e 
universe,  die  proportion  of  Puerto  Ricaai  in  (be  sample  will  be  much  greater  dun  their  proportion 
in  the  tool  population  The  reason  is  that  any  optimisation  proms  luie  that  takes  all  Hispanics  into 
account  will  oversample  eligible  persons  in  Puerto  Rico  honanir  of  the  mvh  lower  screening 
levels  there.  As  we  estimated  earlier,  with  Puerto  Rico  inducted,  both  the  Puerto  Rican  ana 
Mexican  samples  will  be  Large  enough  to  satisfy  the  precision  requitements  for  the  Hispanic 
sample.  The  "othm"  group  will  have  a  rr"jll<*r  sample  the  sample  <1T»*  necessary  to  acmeve 
the  precision  stated  in  the  RFP-  (Far  the  complete  Hispanic  universe  with  100  percent  coverage, 
we  estimated  that  for  "other"  Hispanics  the  sample  will  permit  an  analyst  to  detect  year-to-year 
changes  of  4.0%  instead  of  the  3.0%  inriiraxrri  in  the  RFP.)  On  the  other  Kami  when  Puerto 
Rico  is  ocx  pan  of  the  universe,  the  proportion  of  Puerto  Ricans  in  the  ACOMS  populanon  drops 
coosiderahly.  For  example  with  option  1  of  Table  1.  65  per-  mt  of  the  Hispanic  universe  would 
be  Mexicans.  13  percent  Puerto  Ricans,  and  22  peroent  "other"  Hispanics.  It  would  require  a 
reallocation  of  the  screening  effort  to  achieve  the  desired  precision  far  Puerto  Ricans,  that  is. 
when  the  sample  sue  in  the  Hispanic  areas  is  increased,  a  disproportionately  large  pan  of  the 
increase  would  be  m  the  heavily  Puerto  Rican  areas  such  as  New  York.  The  reallocation  of  the 
screening  workload  may  slightly  reduce  the  precision  of  the  Hispanic  sample. 


Table  1.  Approximate  Hispanic  sample  sizes  available  from  134,000  screened  house*  for  the  four 
option  discussed  in  the  memo  of  February  21 
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Hispanic  Covenss  134.000  Screened  Households  to  Achieve  the  Desired  Precision 

Universe  PucnoKico  IPueno  Rico  Puerto  Rico  (Puerto Rico  Puerto  Rico  Puerto  Rico 

Excluded  Included  Excluded  Included  Excluded  Included _ 

Option  1  80  83  770  1.080  1.230  92C 

Option  2  79  82  760  1,070  1.240  93C 

Option  3  ‘  76  80  740  1,050  1 .260  9JC 

'  _  _  _ _  .  .  n  s  r\ 
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Hispanic 

Universe 


Opoon  1 
Opoon  2 
Opoon  3 
Oooon4 


Approsimaie  sample  sizss  available  from  71X000 
disrnasrri  in  the  memo  of  February  21 


hnascholda  far  the  four  opoon 


Sample  Available  Frees Adriinonal  Imemcws  Needed 
70,000  screened  households  id  Achieve  the  Desired  Precision 
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I  Included 


1  Excluded 


[Included 


ACCMS  Staff 


Attachment  2 


rscti:  Martha  Berlin 

Maura  Gost 

SUBJECT:  Vo  Tech  Sample  Decision  Memo 
DATE:  Nov.  20,  1985 


The  Vo  Tech  supplementation  for  ACOMS  presents  several 
key  issues  that  must  be  investigated.  first,  a  clear  definition 
of  vocational  technical  education  and  a  definition  of  the  unit  of 
Vo  Tech  from  which  students  will  be  selected  must  be  determined. 
Second,  a  two  stage  sampling  procedure  { school/ program  and 
students  within  school/ program)  must  be  outlined.  The  associated 
sources  and  methods  for  sample  selection  of  schools  and  students 
must  be  reviewed.  In  addition,  operational  issues  such  as  the 
timing  of  interview  proc*  res  to  coincide  with  the  operational 
schedules  of  the  sampled  institutions  must  also  be  resolved, 
finally,  it  is  important  to  look  at  the  cost  implications  of  each 
proposed  procedural  alternative. 


I.  DEFINITIONS 


Definition  of  Vo  Tech  Respondent  -  The  targeted 
respondents  for  this  supplementation  to  the  PMS  (as  outlined  in 
both  the  RFP  and  proposal)  are  460  males  who  are  currently 
enrolled  in  a  Vo  Tech  program  at  the  post- secondary  level.  Since 
the  supplementation  is  to  the  PMS  sample,  we  assume  that  the 
respondents  are  to  be  high  school  graduates. 


Definition  of  vocational  Education  -  Vocational 
(occupational)  education  is  defined  by  most  sources,  including 
the  National  Center  for  Education  Statistics  (NCES)  in  their 
Directory  of  Postsecondarv  Schools  with  Occupational  Programs,  as 
"educational  instruction  designed  to: 


prepare  individuals  for  gainful  employment  in 
recognized  occupations  and/or  new  and  emerging 
occupations ; 

assist  individuals  in  making  informed  and 
meaningful  occupational  choices;  and 

upgrade  or  update  the  sJcills  of  individuals 
already  in  an  occupational  field." 


NCZS  also  defines  an  occupational  education  program  as 
being  a  "planned  sequence  of  courses  leading  to  a  specific 
occupational  objective." 


while  the  Directory  enumerates  schools  with  programs 
and  the  RFP  statement  of  Work  speaks  to  the  need  for 
"Supplementing  the  PMS  sample  as  needed  for  vo  Tech  programs..." 
(pg.ll.  Sect  3.3.c),  our  proposal  and  all  subsequent  discussion 
with  XR1  has  dealt  with  the  supplementation  based  on  selecting 
students  from  institutions-  There  are  however,  traditional  post 
secondary  institutions  with  Vo  Tech  programs.  Likewise,  there 
may  be  more  than  one  program  within  a  Vo  Tech  institution. 
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Several  facts  are  germane  to  this  discussion.  They 
also  raise  the  question  of  private/public  inclusion. 


as 


follows: 


o  There  are  approximately  1300  public  vocational 

educational  institutions  which  provide  programs  m 
a  varieey  of  occupational  fields.  These  schools 
represent  only  about  19%  of  all  vocational 
education  institutions. 

o  31%  of  the  vocational  education  schools  are 

private  institutions.  These  institutions  can  be 
broken  down  into  3  general  categories,  as  follows: 
proprietary  (6200),  independent  non-profit  (1100) 
and  religious  group  (600).  The  vast  majority 
(approximately  32%)  of  these  privately  controlled 
institutions  provide  occupational  training  in  only 
one  or  two  occupational  fields. 


This  information  rai-ses  the  concern  that  a  simple 
random  sample  of  institutions  could  severely  limit  the  variety  of 
occupational  programs  from  which  the  sample  of  vo  Tech  enrolled 
students  are  selected. 


The  following  table  provides  some  information  derived 
from  a  random  sample  of  436  schools  listed  in  the  NC2S  Directory 
of  ?ost  Secondary  Schools  with  Occupational  gTnep*m«_ 


Number  of  Program  Categories  Offered 


1 

2 

3 

4«- 

w/in  Private  Schools 

71% 

11% 

3% 

10% 

w/in  Public  schools 

20% 

5% 

2% 

74% 

All  Schools 

53% 

9% 

6% 

27% 

Some  thought  should  be  given  to  the  type  of 
occupational  training  provided  at  the  schools  and  possibly, 
adjustments  made  to  the  base  of  schools /programs  for  those 
schools /programs  whose  enrollment  is  or  could  be  expected  to  be 
predominantly  female. 


An  issue  has  also  been  raised  regarding  the  pcssibilit 
of  being  occupationally  selective  in  the  types  of 
programs/ schools  from  which  the  sample  of  respondents  is 
selected.  The  question  stands,  "Is  it  feasible  to  sample  only 
within  those  types  of  programs/ schools  which  provide  training  in 
the  careers  most  useful  to  the  Amy?" 

Since  the  sampling  procedures  will  obviously  vary 
depending  upon  the  definition  we  reconnend  (schools  vs.  programs 
vs.  selective  schools /programs )  a  resolution  to  this  Issue  is 
Important  before  further  specific  procedures  can  be  finalized. 


II.  SELECTING  SCHOOLS / PROGRAMS  AND  STUDENTS 


There  are  several  sources  that  can  be  used  to  develop  a 
sample  frame  for  the  Vo  Tech  supplementation.  The  attached  table 
indicates  the  Information  available  from  each  source.  These 
sources  could  be  used  as  stand-alone  sample  frames  or  In 
combination  with  one  another.  Updated  information  is  also 
available  for  same  of  the  sources  and  is  so  noted  in  the  ccmments 
section  of  the  table. 


SOURCES /METHODS  FOR  SAMPLING  STUDENTS 


Once  the  sample  of  approximately  100  schools /programs 
has  been  selected,  approximately  5-6  students  will  be  selected 
from  each.  There  are  several  alternative  methods  for  selecting 
these  students. 
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Option  1:  Schools  Select  Sample  of  Students-  One 


alternative  la  to  request  each  o£  the  sampled  schcois/prcgrams  to 
prepare  a  list  containing  name,  address  and  telephone  number  for 
a  random  sample  of  male  students  currently  enrolled  in  Vo  Tech 
programs.  This  list  should  also  provide  the  expected  duration  of 
the  student's  enrollment.  The  procedure  poses  some  specific 
problems: 


Convincing  the  schools  of  the  legitimacy  of  the 
survey  need  and  overcoming  school  concerns  about 
potential  confidentiality  considerations .  In 
previous  similar  surveys  confidentiality  was  one 
of  the  major  concerns  and  reasons  for  refusal 
among  the  schools.  Advance  letters  and  telephone 
contact  will  prove  critical. 

Obtaining  cooperation  in  terms  of  a  time 
consul tment  from  the  schools.  Many  of  these 
schools  are  small,  privately  owned  businesses 
without  the  resources  to  allocate  to  this  type  cf 
task.  In  addition,  the  enrollment  level  in  many 
of  these  schools  is  small  and  therefore,  much  of 
the  needed  information  may  not  be  readily 
available.  '  In  previous  surveys,  this  was  another 
of  the  major  reasons  for  schools  refusing  to 
participate.  We  should  be  prepared  to  offer  our 
assistance,  as  appropriate. 

Adjusting  for  potential  delays  in  the  acquisition 
of  this  information  if  school  concerns  take 
priority  (as  can  be  expected)  over  compilation  of 
these  lists.  Additional  delays  can  be  expected  if 
the  schools  feel  the  need  to  obtain  direct 
permission  from  their  students  before  releasing 
their  names  to  us.  Again,  a  letter  from  Westat 
fully  describing  the  potential  use  of  this 
information  will  be  critical. 

Ensuring  that  the  list(s)  obtained  from  the 
schools  are  accurately  prepared.  Training  of  the 
school  personnel  would  be  important,  especially  if 
the  sample  is  to  be  divided  by  program  rather  than 
by  entire  school  enrollment.  A  clear,  concise  sec 
of  instructions  must  be  prepared  for  the  schools 
so  that  they  can  prepare  the  necessary  information 
in  the  least  amount  of  time  and  with  the  smallest 
potential  for  confusion. 
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Option  2:  Schools  Provide  list  of  All  Students  -  A 
second  approach  is  to  request  that  schools/programs  send  Westat  a 
list  of  all  males  who  are  currently  enrolled  in  Vo  Tech  programs . 
This  list  should  contain  all  the  elements  of  information  listed 
in  Option  1.  This  option  produces  a  slightly  different 
perspective  on  two  of  the  four  issues  discussed  above. 


1.  The  time  commitment  required  of  the  schools  will 
alter.  Depending  upon  the  size  of  the 
school/program  and  the  manner  in  which  records  are 
maintained  {machine  or  hardcopy),  the  time 
required  from  the  schools  may  increase  or 
decrease.  Again,  we  should  be  prepared  to  lend 
assistance  if  necessary. 

2.  The  level  of  quality  control  exercised  by  Westat 
over  the  sampling  of  students  becomes 
significantly  greater  with  this  approach.  The 
schools  would  prepare  a  list  of  all  males  enrolled 
in  Vo  Tech  programs  and  Westat  staff  would  do  the 
actual  sampling. 


Option  3;  Westat  Samples  Students  with  School  Support 
A  third  approach  would  be  for  westat  staff  to  worJc  with 
each  of  the  schools  in  preparing  the  lists.  This  would  require 
obtaining  the  permission  of  each  school  to  allow  a  trained  westat 
staff  member  to  worlt  in  their  facility  for  same  length  of  time 
and  to  have  access  to  their  enrollment  records.  As  with  the 
previous  approaches,  there  are  specific  Issues  associated  with 
this  plan. 


1.  School  concerns  regarding  confidentiality  are  not 
eliminated  if  this  approach  is  used.  In  fact, 
these  concerns  may  very  well  be  exacerbated  by  the 
fact  that  the  Westat  staff  member  may  have 
incidental  access  to  additional  information  that 
is  not  specifically  being  sought. 

2.  The  time  eosnitsent  required  from  the  schools  is 
minimized  but  not  eliminated  with  this  approach. 
The  schools  will  still  need  to  allocate  some  time 
to  instruct  our  staff  members  in  the  organization 
of  the  records.  Additionally,  the  schools  will 
need  to  provide  workspace  for  our  staff  member(s). 


Delays  in  the  acquisition  of  the  lists  would  also 
he  minimized  with  this  approach.  Cnee  a  westat 
staff  member  has  visited  the  school  to  collect  the 
information,  no  further  delay,  due  to  changing 
school  priorities,  should  occur.  However,  a 
potential  delay  still  exists  in  the  early  stages, 
if  the  school  feels  the  need  to  gain  permission 
from  its  students  before  allowing  access  to 
enrollment  records. 

This  method  ensures  a  higher  level  of  quality 
control  in  the  development  of  the  sample  than 
Option  1.  A  thouroughly  trained  westat  staff 
member,  well  instructed  in  the  needs  of  the 
survey,  will  have  the  primary  responsibility  for 
compiling  the  needed  information. 


Option  4:  Acquire  School  Directories  -  Another  method 
for  sampling  students  might  be  to  obtain  copies  of  school 
directories  containing  the  names,  addresses  and  telephone  numbers 
of  current  students.  t  with  the  other  alternatives,  there  are 
specific  difficulties  involved  with  this  approach. 

1.  Not  all  schools  publish  student  directories. 
Different  sampling  methods  would  be  employed  for 
schools  with  published  directories  than  for  those 
that  do  not  have  these  directories.  In  addition, 
most  student  directories  are  published  once  a  year 
for  the  general  use  of  the  student  body  and  are 
not  meant  to  provide  an  accurate,  updated  listing 
of  all  enrolled  students. 

2.  Most  directories  that  are  published  do  not  provide 
the  program/major  study  area  in  which  the  student 
is  enrolled.  If  we  try  to  sample  students  in  only 
the  selected  programs  which  coincide  with  USAREC 
interests,  a  significant  screening  effort  might  be 
involved  to  identify  males  in  Vo  Tech  programs  in 
which  we  are  interested.  In  addition,  if  2  or  4 
year  institutions  offer  many  programs  other  than 
Vo  Tech,  significant  screening  might  also  be 
involved  to  locate  males  in  vo  Tech  programs. 

3.  Again,  confidentiality  could  be  an  issue  of 
concern  that  would  prevent  schools  from  providing 
directories  to  us,  in  those  schools  where  student 
directories  are  published. 
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Cation  5;  Advertisements  In  School  Newspapers  -  A 
final  alternative  for  selecting  currant  vocational  education 
students  would  be  to  publish  an  advertisement  in  the  school 
newspaper  or  post  notices  in  highly  visible  areas  of  the  campus 
requesting  students  to  volunteer  for  participation  in  the  survey. 

1.  The  distribution  of  sample  ’using  this  method  could 
fluctuate  drastically  across  different  schools, 
depending  upon  the  tendency  among  students  at  eac.n 
school  to  volunteer.  It  is  also  likely  that  we 
would  see  a  drastic  and  undesirable  fluctuation  in 
the  representation  of  different  programs  with  this 
method. 

2.  We  would  need  to  obtain  permission  from  each 
school  to  publish  an  advertisement  in  the  school 
newspaper  or  post  notices  in  public  areas.  Here 
again  the  need  exists  to  convince  the  schools  of 
the  validity  of  this  survey.  Some  expense  may  he 
incurred  in  advertising. 

3.  It  is  unlikely  that  a  large  number  of  students  at 
each  school  will  volunteer  initially,  or  follow 
through  at  the  time  of  the  actual  interview  unless 
sene  type  of  direct  incentive  is  provided. 

4.  Nat  all  Institutions  publish  student  newspapers  or 
allocate  space  for  routine  posting  of  information. 
Therefore,  the  sampling  methodology  may  differ  for 
these  schools. 


3.  OPgRATICNXL  ISSUES 


There  are  several  issues  that  will  be  of  operational 
concern  for  ACOMS  regardless  of  the  procedures  used  to  sample 
schoals/proqrams  or  students.  These  cuncems  are  outlined  below: 


a 


Duration  of  "Current"  Status  -  Many  of  the 
vocational/Teehnical  programs  require  attendance  at  a  specified 
series  of  courses  during  a  specified  period  of  time.  The 
duration  of  "current"  status  of  students  within  these  types  of 
programs  is  easy  to  determine.  However  many  programs,  like  those 
in  the  secretarial  area,  involve  much  more  flexible  time  frames. 
Students  can  proceed  with  courses  until  they  reach  a  level  of 
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11  -■'.at  they  feel  is  satiafactory  to  get  them  into  the  ;cb 
market  where  they  will  further  their  skill*.  The  determination 
of  '•current1'  status  among  these  students  ia  much  more  difficult 
eo  determine.  Time  delay  between  sampling  these  students  and 
conducting  the  interviews  should  be  minimized  in  order  to  reduce 
the  impact  of  these  situations. 

Gaining  School  Cooperation  -  Cne  of  the  most  difficult 
tasks  of  this  Vo  Tech  supplementation  process  will  be  to  gain  the 
cooperation  of  the  schools.  Some  of  the  reasons  for  this 
difficulty  involve  concerns  about  the  confidential  nature  of  the 
information  we  are  requesting  and  school  concerns  about  their 
legal  and  ethical  responsibilities  in  this  issue;  the  resources 
of  and  costs  to  the  schools  to  provide  us  with  the  requested 
information;  and  the  natural  tendencies  of  the  school  Directors 
or  other  personnel  to  participate  or  refuse.  Advance  letters  and 
early  telephone  contact  to  assure  schools  of  the  importance  of 
the  survey  and  Westat's  strict  confidentiality  procedures  will  be 
critical. 

Operating  Schedule  of  Schools  -  The  operating  schedules 
for  Vocational/Technical  schools  might  pose  problems  in  our 
ability  to  equally  distribute  the  Vo  Tech  sample  throughout  the 
year.  However ,  information  gathered  during  the  vocational 
Education  Facilities  Study  (1978)  indicates  that  96%  of  vo  Tech 
oostsecondarv  institutions  offer  programs  year  round.  This  would 
allow  for  an  equal  distribution  of  the  Vo  Tech  sample  throughout 
the  year. 


Consent  of  Students  -  In  many  instances,  sampled 
schools  may  refuse  to  provide  us  with  any  information  without 
first  obtaining  consent  from  the  students  involved.  In  these 
instances  again,-  advance  letters  are  critical.  Obtaining  this 
consent  from  the  students  may  create  administrative  problems  for 
the  schools  and  we  should  be  prepared  to  lend  assistance  as 
appropriate. 


t 


^ancrandun 


fR CM: 


Benia  Nieva 
Joe  Waksberg 


Attacrmenc 


December  17,  1335 


SUBJECT:  VO  Tech  Sample  for  ACCMS 


Martha  and  Maura  addressed  a  number  of  issues  regarding  the 
vo  Tech  sample  in  their  November  20  memo.  Some  additional  topic 
are  discussed  below. 

1.  Definitions 

The 'December  10  ACCMS  memo  stated  that  a  decision  has  been 
made  that  the  VO  Tech  sample  will  include  high  school  graduates 
only.  This  obviously  will  exclude  youths  taJcing  vo  Tech  trainin' 
in  high  schools.  Also,  some  of  the  vo  Tech  students  j.n  both  the 
ROD  and  the  school  sample  will  be  lost  because  they  are  not  high 
school  graduates.  (Although  I  have  not  found  any  specific  data 
that  will  predict  the  losses,  they  do  not  appear  to  be  large. 

The  last  Census  Bureau  report  on  the  subject  —  for  1976  — 
showed  that  about  10  percent  of  persons  enrolled  in  vo  Tech 
programs,  excluding  those  in  high  school,  had  not  completed  hi gn 
school.  Unfortunately,  the  Census  report,  in  addition  to  being 
almost  10  years  old,  does  not  have  separate  data  by  sex,  or  for 
persons  16-24  years.) 

I  assume  we  also  want  to  exclude  students  taJcing  vocational 
subjects  in  regular  two-year  or  four-year  colleges.  A  Census 
Bureau  study  in  October  1982  indicated  that  there  were  more 
students  in  college  in  a  vocational  education  program  than  in 
other  poatsecondary  institutions.  Our  sample  size  calculations 
assumed  these  students  will  be  part  of  the  college  sample  rather 
than  the  VO  Tech  sample.  Do  we  r.eed  a  confirmation  of  this? 

Our  calculations  also  assumed  that  the  vo  Tech  sample  will 
cover  full-time  and  part-time  students  and  persons  in 
correspondence  schools.  (The  1976  Census  Bureau  report  stated 
that  7  percent  of  the  males  14-21  years  old  enrolled  in 
vocational  schools  were  in  correspondence  schools.)  I  would  Ilk 
to  make  sura  we  have  agreement  on  this.  It  will  affect  both  the 
sample  size  and  the  questionnaire. 

There  are  also  timl.-.g  problems  that  should  be  considered. 
Should  our  questions  be  on  "currently  enrolled"?  If  so,  what 
happens  during  summer  months?  The  Census  study  asked  about  both 
current  enrollment  and  enrollment  in  the  past  12  months. 
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2 .  aespcnse  and  Sampling  Issues 

The  Westat  proposal  for  this  study  recommended  a  dual  frame 
approach  with  part  of  the  sample  generated  in  the  random  digit 
dialing  sample  and  part  selected  by  going  to  a  sample  of  vo  Tech 
schools.  On  further  consideration,  I  think  we  should  use  only 
the  VO  Tech  school  sample  for  this  component  of  the  study. 

Combining  the  SOD  and  school  samples  implicitly  assumes  the 
two  measure  the  same  concept.  There  is  some  uncertainty  whether 
this  is  the  case.  A  respondent's  replies  to  questions  on  vo  Tech 
courses  will  reflect  his  perception  of  what  is  meant  by  vo  Tech 
enrollment.  Census  experience  Indicates  there  may  be 
considerable  difference  between  the  respondent's  understanding 
and  what  we  have  in  mind.  Methodogical  studies  on  accuracy  and 
consistency  of  reporting  vo  Tech  in  the  1970  Census  and  in  a  1973 
study  (copy  attached)  indicated  quite  poor  quality  of  reporting. 
It  is  uncertain  whether  the  same  problems  will  occur  in  our  study 
since  the  Census  questions  ashed  about  lifetime  experience  in 
vocational  education.  It  is  likely  that  current  enrollment  is 
not  subject  to  the  same  problems.  However,  at  least  some  of  the 
causes  of  poor  reporting  look  as  if  they  will  also  affect  current 
enrollment  statistics. 

Selecting  a  sample  from  VO  Tech  schools  will  provide 
statistics  for  a  universe  of  students  that  can  be  clearly 
defined.  Consequently,  I  suggest  that  we  increase  the  sample  of 
students  selected  from  vo  Tech  schools  to  700,  the  full  number 
desired  by  ARI .  The  additional  cost  will  be  fairly  modest  once 
we  have  obtained  cooperation  from  the  schools  and  received  lists 
of  students. 
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As  far  as  the  HDD  component  is  concerned,  we  will  be  free  to 
ask  the  vo  Tech  questions  or  abandon  them.  It  might  be 
interesting  to  ask  questions  on  vo  Tech  enrollment  and  the  names 
of  the  schools  in  which  enrolled.  The  schools  could  then  be 
compared  to  those  on  the  frame.  Students  in  schools  not  on  the 
frame  would  provide  information  on  the  extent  to  which  vocational 
education  is  going  on  outside  the  set  of  institutions  that  are 
normally  considered  as  providing  this  education  (assuming  there 
are  not  too  many  problems  in  matching  the  two  lists ) .  The 
implications  of  this  kind  of  analysis  could  be  reflected  in  plans 
for  ACONS  in  future  years. 


If  the  cost  of  this  investigation  is  not  very  great,  I 
suggest  carrying  it  out.  I  doubt  that  it  is  worth  putting 
substantial  resources  into  it. 
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3 .  Tlalng  of  Data  Collection 

If  we  want  to  restrict  our  samp.*  to  those  who  are 
"currently  enrolled",  there  will  be  soma  delicate  prcclema  on  the 
timing  of  the  operation.  From  the  information  I  have  „ooked  at, 
it  appears  as  if  there  is  considerable  turnover  in  the  student 
body  in  vo  tech  schools.  Some  of  this  is  due  to  some  of  the 
courses  having  a  fairly  short  duration.  Other  reasons  are 
relatively  high  dropout  rates  and  the  fact  that  courses  do  not 
necessarily  keep  to  conventional  school  calendars. 

Consequently,  selecting  a  sample  of  students  at  one  point  in 
time  and  then  interviewing  then  over  the  following  year  is  likely 
to  produce  erratic  results.  Many  of  the  students  will  no  longer 
be  enrolled,  and  we  will  be  missing  new  cohorts. 

The  contact  with  the  students  should  therefore  be  made  seen 
after  the  lists  are  obtained.  This  implies  that  the  sample  of 
schools  will  need  to  be  divided  into  12  random  subsets,  with  the 
list  for  each  subset  obtained  in  a  different  month.  Since  there 
is  likely  to  be  a  fairly  long,  and  variable  time  period  needed  to 
get  the  schools  to  agree  to  cooperate,  the  initial  arrangements 
should  not  include  the  preparation  of  the  lists  of  students. 

An  alternative  is  to  interview  all  the  vo  Tech  respondents 
in  a  relatively  short  period  of  time.  Zf  there  are  important 
seasonal  or  other  temporal  factors,  this  would  create  problems  m 
comparing  the  VO  Tech  and  other  KPS  respondents.  I  doubt  that  we 
should  recommend  this  alternative. 

If  the  definition  of  vo  Tech  is  changed  from  "currently 
enrolled"  to  something  like  "enrolled  during  a  certain  period  — 
the  last  12  or  6  months",  the  timing  problems  are  considerably 
reduced,  we  can  then  ask  the  school  for  students  who  were 
enrolled  anytime  during  a  fixed  period  (e.g.,  January-June  1936) 
and  allocate  the  sample  to  various  months. 

4 .  Decision  Requirements 

As  we  have  discussed  previously,  a  fairly  long  lead  time  is 
needed  to  organize  the  frame  of  schools,  select  the  sample,  and 
arrange  for  cooperation.  We  should  cry  to  get  decisions  rather 
quickly  on  the  three  items  above.  I  would  like  to  shoot  for 
agreement  by  the  end  of  December  so  we  can  get  started  on  the 
next  steps  early  in  January. 

JW:mlp 


cc:  Martha  Berlin 
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Table  K.  Regular  School  or  Vocational  School  Enrollment,  by  Family  Income  (or  Dependent  Family 
Members  18  to  24  Years  Old:  October  1976 


Numbers  in  'nn-isjMda  -  Lwili.an  n  ^ninsc  i  Cut  ional  population) 


Enrol  Ine-t  age ,  and  sex 

Total1  , 

Faai  ly 

incooe 

Under 

$5,000 

$5,000  to 
$9,999 

$10,000  to 

$14,999 

$15,000  to 
$19,999 

$20,000  to 
$24,999 

$25,300 
and  over 

l-uHI  -sEXLS 

Total,  18  to  24  years  old . | 

14,222 

1,353 

2,277 

2,700 

2.198 

1.737 

2 ,47a 

Percent . 

100.0 

100. 0 

100.0 

100. 0  i 

ioo.o  : 

100.0 

1U0.0 

Enrolled  below  college . 

6.0 

11.4 

8.5 

6-7  ! 

4-5  ; 

3.2 

2.3 

Enrolled  in  college . 

38.8 

20.3  ; 

25.1 

34.2 

42.3 ; 

50.  1 

57.7 

Enrolled  in  vocational  school . 

3.6 

3.2 

4.3 

3.9 

3-5  ; 

4.8 

3  . 

Not  enrolled  m  school* . 

51.6 

64.9 

61.4 

54.9 

49.4 

41.6 

36.5 

MALE 

Total,  18  to  24  years  old . 

7  .941 

707 

1,273 

1 ,496 

1,274 

955 

i  ,  4  l  1 

Percent . 

100.0 

100. 0 

100. 0 

100.0 

100.0 

100.0 

100.0 

Enrolled  below  college . 

7.0 

14.1 

10.0 

8.4 

5.  i 

3.2 

2.  1 

Enrolled  in  college . 

35.3 

17.1 

21.4 

30.0 

38.3 

45.1 

54.0 

Enrolled  in  vocational  school . 

3.4 

4.0 

3.5 

3.5 

3.1 

5.4 

3.0 

Not  enrolled  in  school* . 

54.4 

64.6 

63.8 

57.7 

52.9 

45.9 

40.0 

FEMALE 

local,  18  to  24  years  old . 

6,281 

646 

1,004 

1 , 205 

924 

782 

1  ,063 

Percenc . 

100. 0 

100. 0 

100.0 

100.0 

100.0 

100.0 

100.0 

Enrolled  below  college . 

8.4 

6.6 

4.7 

3.4 

3.3 

2.6 

Enrolled  in  college . 

23.8 

29.9 

39.4 

47.8 

56.1 

62.6 

Enrolled  in  vocational  school . 

2.3 

5.2 

4.2 

3.9 

4.1 

3.  : 

Not  enrolled  in  school*  . 

1 _ ^ 

65.0 

58.2 

51. 5 

44.5 

36.2 

310 

1 


1  Includes  persons  with  family  income  not  reported,  not  shown  separately. 
*  Includes  persons  with  enrollment  in  vocational  school  not  reported. 


METHODOLOGICAL  NOTE 

Previous  analyses  of  response  errors  to  questions  on  voca¬ 
tional  training  have  shown  that  individuals  are  not  likely  to 
provide  highly  reliable  answers  to  questions  on  whether  they 
had  completed  a  vocational  training  program.  Although  no 
such  analysis  was  conducted  for  the  series  of  questions  used 
m  the  October  1976  Current  Population  Survey,  two  studies 
on  the  reliability  of  reporting  have  been  conducted,  one  in 
1970,  based  on  the  1970  Census  of  Population,  and  another 
in  1976.  based  on  the  National  Content  Test  for  the  1980 
census. 

In  the  1970  Census  of  Population  5-percent  sample, 
persons  14  years  old  and  over  answered  a  two-part  question 
on  vocational  training  and  their  main  field  of  study.1 
Respondents  were  instructed  to  count  only  programs  that 
were  finished;  to  -elude  Job  Corps  training;  to  omit  courses 
which  were  not  part  of  an  organized  program  of  study,  train¬ 
ing  received  or  the  job,  in  a  company  school  in  college  after 
the  second  year,  by  correspondence,  or  in  basic  training  in  the 
Armed  Forces.  Under  these  circumstances,  a  wide  range  of 


See  U  S  Bureju  of  rhe  Census.  Census  of  Population  ar  d  Hous¬ 
ing  1970,  Evaluation  and  Research  Program  PHCIE?  9.  Accuracy  of 
Data  for  Selected  Population  Characteristics  as  Measured  by  Reinter- 
views,  pg  1 5-23 


training  experiences  may  have  been  reported  as  vocational, 
including  those  that  are  without  question  vocational  as  well 
as  those  that  were  more  marginal  in  nature. 

A  reinterview  of  5,000  households  was  conducted  in 
which  persons  were  questioned  in  detail  about  any  training 
that  might  be  considered  vocational;  if  a  potential  training 
program  was  detected,  a  series  of  questions  was  asked  for  the 
purpose  of  obtaining  data  on  the  nature  of  the  program. 
These  data  included  the  field  of  training,  where  or  how  the 
training  was  received,  whether  the  training  program  was 
completed,  the  year  the  training  was  received,  the  usefulness 
of  the  training  in  a  civilian  job,  and  the  number  of  weeks  and 
hours  spent  in  the  training  program.  The  data  also  provided  a 
basis  for  identifying  those  persons  having  training  ex¬ 
periences  which  were  clearly  not  to  be  reported  as  vocational 
training  according  to  the  respondent  and  enumerator  in¬ 
structions,  as  well  as  those  having  no  training  experience. 

In  1976,  further  evaluation  of  the  vocational  training  item 
was  made  possible  by  the  National  Content  Test.2  Since  the 
1970  census  evaluation  study  showed  that  a  high  percentage 
of  persons  who  reported  "Yes"  on  vocational  training 
actually  did  not  complete  a  program,  a  new  question  format 


’Results  Memorandum  Number  16,  f'om  David  L.  Kaplan. 
"Evaluation  of  the  1976  Reinterview  Survey  for  School  Enrollment, 
Educational  Attainment,  and  Vocational  Training,"  prepared  by 
Larry  E.  Suter,  December  16.  1978. 
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was  attempted  >n  the  National  Content  Test  to  clarify  the 
type  of  training  that  should  be  reported.  The  questionnaire 
specified  that  only  persons  who  had  received  a  certificate  in 
vocational  training  mould  report  they  completed  a  voca 
tionai  program,  atso  me  length  of  the  program  of  study  was 
obtained  so  that  persons  wnp  had  attended  for  short  periods 
could  be  separated  from  those  with  more  extensive  training. 
When  these  persons  were  interviewed,  more  detail  about  the 
attended  program  was  requested. 

Of  the  persons  identified  on  the  census  form  as  having 
completed  a  training  program  which  might  qualify  as 
vocational,  only  about  62  percent  reported  completing  a 
vocational  training  program  in  the  remterview  questionnaire. 
On  the  other  hand,  a  significant  number  of  the  persons  who 
said  they  had  not  completed  a  program,  did  say  so  in  the 
reinterview  (9  percent).  In  general,  the  types  of  vocational 
programs  most  completely  reported  include  those  that 
currently  were  being  used  m  the  job,  those  that  involved 
2,000  or  more  hours  of  training,  and  those  that  were  taken  in 
a  trade  or  technical  school. 

A  large  number  of  persons  erroneously  reported  com¬ 
pleting  a  vocational  training  program  in  the  census.  The 
remterview  data  show  that  about  38  percent  of  the  persons 
who  reported  completing  a  vocational  program  on  the  census 
questionnaire  had  not  done  so  by  the  census  definition. 
About  29  percent  reported  training  experiences  which  were 
clearly  not  to  be  reported  as  vocational  according  to  the 
census  instructions,  and  an  additional  9  percent  indicated  in 


the  remterview  that  they  had  never  received  any  type  of 
training  that  might  be  considered  as  vocational. 

A  comparison  of  the  responses  to  the  mailout  question 
naire  and  the  remterview  indicated  that  the  derailed  ques¬ 
tions  were  not  more  reliable  than  the  responses  received  in 
the  1970  census  item  on  vocational  training,  although  the 
question  was  more  specific.  A  smaller  proportion  of  the 
population,  about  13  percent  of  persons  in  the  mailout 
questionnaire  and  about  11  percent  of  persons  m  the 
remterview,  were  found  to  have  received  a  certificate.  About 
one-half  of  those  who  reported  having  received  a  certifi¬ 
cate  in  the  mailout  survey  did  not  report  it  in  the  follow-up 
remterview.  Also,  a  large  number  of  persons  who  reported 
that  they  had  not  completed  a  program  in  the  mailout 
questionnaire  were  reported  as  attending  and  completing  a 
vocational  program  m  the  remterview. 

Information  gamed  from  the  National  Content  Test 
suggests  that  the  meaning  of  "vocational  training"  may  not 
be  clear  to  respondents,  which  may  be  partly  due  to  the  lack 
of  a  national  consensus  on  the  meaning  of  a  vocational 
education  progiam.  The  amount  of  variation  in  the  type  of 
training  which  might  be  considered  vocational  (such  as  the 
addition  of  adult  education  programs  in  colleges  m  recent 
years)  is  so  great  that  summary  measures  are  not  highly 
successful.  Vocational  training  may  occur  m  many  different 
forms,  thus  making  it  difficult  to  distinguish  occupational 
education  from  courses  intended  for  nonoccupational 
reasons. 
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ViEMCBANOUM 


TO:  Rome  Slava  December  4,  138  5 

FROM;  Jce/wa ksberg 

SUBJECT:  Hispanic  Sample  far  ACCMS 


Leyla  recently  completed  a  report  on  ''Comparison  of 
Alternative  Procedures  for  Oversampling  Hispanics"  which  compare' 
the  number  of  interviews,  screenings  and  costs  for  three  differ¬ 
ent  sampling  methods  for  Hispanics.  Her  report  also  derived  one 
approximate  sample  sires  for  the  distribution  of  the  sample  ay 
Hispanic  derivation  for  the  alternates.  I  would  like  to  make 
several  recommendations  for  our  next  steps  in  regard  to  the 
Hispanic  sample. 


1.  Alternative  Sampling  Methods 

The  efficiency  of  the  various  alternatives  is  summarized  m 
Table  4-1  of  I^yla's  memo.  Basically,  Table  4-1  shows  that  the 
cost  of  both  alternatives  will  be  about  25  to  35  percent  aelcw 
the  cost  of  straight  random  digit  dialing.  Furthermore, 

Table  4-1  Indicates  that  the  Spanish  Surname  procedure  will  cost 
about  6  or  7  percent  less  than  she  area  stratification  method. 
(The  per  interview  cost  will  probably  be  about  5  to  10  times  the 
per  screening  cost,  so  that  values  of  Cj/Cj.  of  5  and  10  should 
encompass  the  cost  ratios  we  are  concerned  with. ) 

It  is  clear  that  straight  RDD  should  be  rejected.  The 
Spanish  Surname  procedure  seems  to  have  an  edge  over  area  strati 
fication,  but  the  difference  is  fairly  modest.  It  is  useful  ta 
examine  other  features  of  the  two  systems  to  see  whether  they 
should  influence  our  decision.* 


*we  have  not  examined  a  sample  design  which  combines  a  Spanish 
Surname  list  with  area  stratification.  Sven  though,  on  paper, 
this  would  be  mere  efficient  than  either  method  alone,  we  are 
nesltant  to  introduce  the  added  complexities  with  the  attendant 
chances  of  error  that  occur  with  complex  systems.  I  think  we 
should  explore  a  combined  method  but  I  prefer  to  delay  an  analy 
sis  of  its  properties  until  we  have  the  survey  underway,  and 
then  try  it  out  on  a  small  scale  basis,  possibly  in  one  or  two 
states  or  in  a  Bde. 


I  have  one  ma j or  concern  about  the  Spanish  Surname 
procedure.  The  optimization  and  level  of  screening  and  inter¬ 
viewing  is  sensitive  to  the  amount  of  attrition  m  the  Donnelley 
list.  Section  2.1  of  Layla's  memo  shows  a  IS  percent  loss 
because  some  households  with  Spanish  Surnames  are  not  Hispanic, 
and  a  10  percent  loss  for  other  reasons.  The  13  percent  loss  is 
based  on  Census  studies  and  should  be  reasonably  close  to  wnat 
will  occur  in  practice.  The  10  percent  loss  estimate,  however, 
is  a  guess  on  our  part.  If  it  is  way  off  the  marie,  the  Spanisn 
Surname  procedure  could  be  much  less  efficient  than  we  estimated. 

There  may  be  other  problems  as  well.  For  example,  we 
assumed  the  proportion  of  Hispanic  households  with  eligible 
youths  in  telephone  households  was  the  same  in  nontelephone 
households;  and  that  the  nonresponse  rates  in  Hispanic  households 
will  be  about  the  same  as  in  all  households.  However,  it  is 
unlikely  that  these  assumptions  could  be  so  seriously  in  error  to 
have  an  important  effect  on  the  comparisons.  3ut  if  the 
10  percent  loss  turns  out  to  be  20,  or  30,  or  40  percent,  tne 
effect  would  be  very  serious. 

The  area  stratification  procedure  suffers  from  a  related 
problem.  The  optimization  was  based  on  an  estimated  distribution 
of  the  proportion  of  Hispanic  households  in  telephone  exchanges 
with  heavy  concentrations  of  Hispanics,  moderate  concentrations, 
etc.  The  distribution  assumed  certain  relationships  between 
telephone  exchange  dat*  and  tract  data  ( for  which  tabulations 
were  available).  In  addition,  the  tract  data  are  quite  old.  Hew 
close  this  distribution  is  to  what  will  be  found  in  practice  is 
quite  uncertain. 

tty  personal  feeling  is  that  the  area  stratification  design 
is  probably  not  as  sensitive  to  errors  in  the  distribution  as  the 
Spanish  Surname  method.  A  conservative  position  might  then  be  to 
choose  area  stratification  in  spite  of  the  fact  that  it  appears 
to  be  more  costly.  However,  there  is  an  argument  for  the  reverse 
position  also.  If  the  Spanish  Surname  method  turns  out  to 
provide  fewer  Hispanics  than  required,  it  will  be  quite  easy  and 
fairly  cheap  to  supplement  the  sample  by  adding  persons  from  the 
Spanish  Surname  list.  (We  should  purchase  more  names  from 
Donnelley  than  we  plan  on  using.)  Area  stratification  does  not 
quite  provide  the  same  flexibility  since  a  smaller  proportion  of 
Hispanics  appear  to  reside  in  concentrated  Hispanic  areas. 

As  far  as  costs  of  purchasing  material  from  Donnelley  is  - 
concerned,  the  Spanish  Surname  list  is  cheaper  but  not  by  very 
much.  Data  for  the  area  stratification  method  will  run  about 
125,000  whereas  the  Spanish  Surname  list  will  only  cost  a  couple 
of  thousand  dollars  (Including  matching  for  weighting  purposes). 
However,  since  the  area  stratification  data  are  based  on  the  1980 
Census,  wnicn  cannot  be  updated,  it  can  be  used  for  the  next  five 


years  of  ACCMS.  The  Spanish  Surname  list  would  have  to  be 
renewed  each  year. 


My  reconanendation  is  to  examine  the  extent  of  the  problems 
by  carrying  out  a  limited  amount  of  testing  as  part  of  our 
general  pretest  plans.  I  suggest  we  purchase  both  frames  from 
Ccnneliey  ( that  is  the  telephone  exchanges  coded  by  1380  Census 
characteristics,  and  a  set  of  names  from  the  Spanish  Surname 
file)  for  one  or  two  states,  examine  the  lists  (e.g.,  cnecx  for 
existence  of  telephone  numbers  on  the  Spanish  Surname  list)  and 
do  a  moderate  amount  of  calling  of  numbers  on  both  lists.  This 
should  give  us  a  reasonable  basis  for  a  decision. 

I  would  like  to  move  fairly  quickly  to  make  sure  we  have 
results  in  time  for  the  start  of  data  collection  operations. 


Hispanic  Derivation 


The  Westat  Proposal  reccmnended  that  there  be  no  attempt  to 
enlarge  the  sample  of  '’other"  Hispanics.  The  more  detailed  anal¬ 
ysis  of  the  sample  sizes  in  Ley la's  memo  confirms  this  position. 
There  does  not  seem  to  be  any  easy  way  to  increase  the  sample  of 
"other"  Hispanics  in  a  way  that  would  reduce  the  sampling  errors 
appreciably.  The  Spanish  Surname  lisn  does  not  contain  a  large 
enough  part  of  the  total  Hispanic  population  to  maJce  sample  sup¬ 
plementation  from  the  list  alone  an  efficient  procedure. 
Similarly,  restricting  oversampling  to  particular  geographic 
areas  (e.g.,  Miami)  would  add  sample  cases  but  would  not  have 
much  effect  on  variances. 


I  suggest  we  stick  with  our  original  recommendation.  I 
don't  think  this  means  we  have  to  keep  from  analyzing  data  for 
"other”  Hispanics.  A  sample  of  400  to  500  cases  can  provide 
useful  results.  However,  the  levels  of  cross-classif ication 
should  be  kept  fairly  simple. 


Total  Screening  effort 


Tables  2-2  and  3-3  of  Layla' s  report  indicate  that  the 
screening  level  will  be  somewhere  in  the  105,000  to  115,000 
range.  About  3,000  to  4,000  of  this  will  be  in  Puerto  Rico, 
with  area  stratification,  screening  will  need  to  be  attempted  for 
about  110,000  households  outside  of  Puerto  Rico,  with  the 
Spanish  Surname  procedure,  the  screening  sample  should  be  about 
100,000  (not  including  Puerto  Rico  or  the  Spanish  Surname  list). 
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These  levels  of  screenings  are,  of  course,  greatly  in  excess 
of  the  70,000  required  to  produce  the  9603  ?MS  sample.  They  wi_l 
ccme  close  to  providing  the  2400  four-year  college  students,  out 
not  quite  make  it.  They  will  also  give  us  the  option  -*  increas¬ 
ing  the  sample  size  for  two-year  college  students,  SMS,  and  the 
convenience  sample. 

In  regard  to  four-year  college  students,  although  the 
Spanish  surname  procedure  calls  for  a  smaller  number  of  screen¬ 
ings  than  area  stratification,  it  is  probably  a  little  better  for 
purposes  of  studying  students.  This  is  due  to  the  fact  that  wion 
the  Spanish  Surname  procedure,  we  will  have  a  self -weighting 
sample  for  the  100,000  screenings  outside  of  Puerto  Rico  and  the 
Spanish  Surname  list,  with  area  stratification,  the  sampling 
rates  will  vary  and  the  variation  will  increase  the  variances. 

In  addition,  the  highest  sampling  rates  will  occur  in  concen¬ 
trated  Hispanic  areas  which  probably  have  a  lower  percentage  of 
college  students.  The  number  in  the  sample  will  thus  probaoly  be 
somewhat  lower  with  area  stratification  than  with  the  Spanish 
Surname  procedure,  even  though  more  households  will  be  screened. 

It  should  be  noted  that  we  previously  estimated  that  without 
oversampling  for  Hispanics,  a  screening  sample  of  114,000  was 
necessary  to  provide  2400  male,  KPS,  four-year  college  students. 
This  assumed  a  self -weighting  sample,  with  the  Spanish  Surname 
procedure,  the  114,000  sample  needed  for  college  students  will 
need  to  be  enlarged  in  Puerto  Rico  and  a  sample  selected  from  the 
Donnelley  list  to  satisfy  the  Hispanic  requirements .  This  will 
increase  the  screening  workload  by  about  10,000.  with  area 
stratification,  the  screening  sample  in  strata  with  low  concen¬ 
trations  of  Hispanics  will  need  to  be  increased,  probably  ny  one 
same  amount  -  10,000. 
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COMPARISON  OF  ALTERNATIVE  PROCEDURES 
FOR  OVERSAMPLING  HISPANICS 


Introduction 

Characteristics  of  Spanish  Surname  Method 

2.1  Sasic  Parameters 

2.2  Assumptions 

2.3  Optimum  Number  of  Interviews  per  Sampling  Stratum 

Characteristics  of  Area  Stratification  by  Hispanic 
Concentration 

3.1  Basic  Parameters 

3 . 2  Assumptions 

3.3  Optimum  Number  of  Interviews  per  Sampling  Stratum 

Relative  Efficiency  of  Area  Stratification  Compared  to 
the  Spanish  Surname  Method 

Screening  for  Hispanic  Derivation 
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1.  I^TSOOUCTIOM 


The  tvo  alternatives  available  for  oversampling 
Hispanics  are  to:  (1)  locate  a  partial  list  of  Hispanics  (not 
necessarily  complete) ,  and  then  um  a  dual-frame  approach  sample 
both,  from  the  list  and  random  digit  dialing  (HDD) ,  and  (2) 
stratify  the  papulation  to  identify  areaa  with  heavy  concentra¬ 
tion  of  Sispanica,  and  overaample  the  designated  areas.  As  the 
third  alternative,  ve  can  simply  increase  the  screening  sample  to 
achieve  the  desired  sample  size.  As  will  be  seen  later,  this 
latter  alternative  is  the  most  expensive  approach. 

ror  the  first  alternative  ve  can  use  a  partial  lia* 
that  is  developed  by  the  Donnelley  Marketing  Information  Serv¬ 
ices.  Donnelley  Marketing  has  informed  us  that  they  have  a  list 
of  2.1  million  telephone  subscribers,  coded  on  the  basis  of  the 
Spanish  surname  file  established  and  used  by  the  Census  Bureau. 
Donnelley  Marketing  can  also  supply  a  list  of  all  telephone 
exchangee,  with  19(0  census  data  for  each  exchange,  based  on  an 
approximate  matching  of  telephone  exchanges  with  Census  geogra¬ 
phy.  For  the  second  alternative  ve  vill  use  Census  data  to 
obtain  information  on  the  concentration  of  Hispanics  in  different 


In  this  report  ve  vill  compare  the  tvo  alternative 
aethods  for  oversampling  Hispanics  each  one  based  on  the  results 
of  an  optimization  procedure  vith  the  objective  of  achieving  the 
desired  precision  in  the  estimates  at. minimum  cost. 

It  should  be  noted  that  the  sample  sizes  mentioned  in 
the  proposal  are  the  ones  required  to  achieve  the  precision  . 
stated  in  the  JOT,  if  the  Hispanic  sample  is  a  simple  random 
sample.  HDD  by  itself  comes  close  to  being  a  simple  random 
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sampla  bur  naithar  tha  dual  fra aa  nor  tha  araa  Gratification 
aathoda  produca  salf-vaightlng  or  siapla  random  saaplas.  Tbaaa 
aathods  incraaaa  tha  sampling  variancas  ovar  thoaa  from  a  salf- 
vaightlng  sampla.  Tharafora,  tha  nuabar  of  intarviawad  caaas  baa 
to  ba  incraasad  to  provida  tha  praciaion  raqulrad  in  tha  RTP. 

Any  gaina  in  affieiancy  will  coma  from  tha  poaaibla  raductiona  in 
t&a  scroaning  affort  which  mora  than  companaata  for  tha  incraasad 
intarviaving  workload. 

3 actions  2  and  3  provida  tha  raaulta  of  tha  optimiza¬ 
tion  procadura  for  tha  Spanish  lurnams  and  araa  stratification 
aitarnativaa.  A  comparison  of  tha  two  mathodm  basad  on  ralativa 
coat  of  amploying  tha  two  aathods  is  givan  in  Saction  *. 

Saction  3  concludaa  tha  raport  by  discussing  soma  othar  aspacts 
of  ovarsampling  Hispanics. 


2.  CHARACTERISTICS  OP  SPANISH  StTRMAMZ  METHOD 


This  Mctlon  provides  the  basic  information  needed  for 
the  optimization  procedure  for  tha  Spaniah  lursua  method.  Most 
a t  tha  following  data  for  the  SO  atataa  ara  baaad  an  the  1984 
Currant  Papulation  Survey  estimates.  Tha  proportion  of 
households  with  talaphonaa  ara  baaad  on  aarliar  data.  Tha  data 
for  Puarto  Rico  ara  Sestet's  updataa  froa  tha  1980  census. 


Mo.  at  Spanish  origin  bouaaholda 
(excludes  Puarto  Pico) 

*  of  bouaaholda  with  talaphonaa 

Mo.  of  Hispanic  bouaaholda  with  talaphonaa 

Screening  rata  far  Hispanic  bouaaholda 


so.  at  Spaniah  «u i  naa  bouaaholda  on 

Donnelley 's  list  { axcludaa  Puarto  Rico) 
«  of  spaniah  auraaaaa  that  ara  not 
Hispanic 

Asauaed  %  loaa  for  othar  raaaona 

(talaphona  rruahar  missing,  moved,  ate.) 
So.  of  Spaniah  aumaaa  bouaaholda  on 

Donnelley' s  list  that  ara  Hispanic 
and  available 

Screening  rata  for  Hispanic  bouaaholda 
%  of  Hispanic  bouaaholda  with  talaphonaa 
an  Donnelley’ a  list 

So.  of  Hispanic  households  in  Puarto  Rico 
%  of  bouaaholda  with  talaphona 
So.  of  households  with  talaphona 
Screening  rata  for  Hispanic  households 

So.  of  Hispanic  households  per  eligible 
person  (axcludaa  Puarto  Rico) 

So.  of  Hispanic  households  per  eligible 
person  in  Puerto  Rico 


4.326, 900 

35 

3,677,100 

21.1 


2,100,000 


1, 606,000 
1.31 


911,100 

30 

728,366 

1.1 


TaOla  3-2.  Opclaua  aaapla  inu  and  iha  aaaociatad  scraanlnq  afforta 
£ or  taa  SpanlaA  tunvut  altamaelva  By  Cj/C^ 
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1 

1170  . 

1904 

503 

3043 

3190 

10,349 

40,230 

104, 103 

3 

*31 

1424 

333 

30T7 

4004 

•409 

*3,432 

103. 225 

10 

703 

1410 

300 

2739 

2439 

7073 

*0,271 

100 . 494 

13 

707 

1299 

303 

2304 

2120 

4200 

103,224 

111,426 

20 

*30 

1212 

400 

2470 

2903 

3730 

103,294 

114, 229 

23 

023 

1131 

413 

2300 

2743 

3310 

100,022 

114,293 

aa 

200 

730 

900 

2000 

1077 

1939 

130,097 

141, 709 

2 . 2 


Aaauanr Ians 


Tha  optimization  approach  la  basad  on  tha  following 
assumptions. 


(a)  Population  variancaa  for  Hiapanica  on  tha 
Oonnallay  liat  la  aqual  to  population  variancaa 
for  thosa  not  on  tha  liat  and  thoaa  in  Puarto 
Rico. 

(b)  Ago  distribution  for  Hiapanica  on  tha  Donnallay 
liat  ia  tha  aaaa  aa  thoaa  Hiapanica  not  on  tha 
liat  and  thosa  in  Puarto  Rico. 

(Kota:  Tha  fact  that  thaaa  two  assumptions  probably  ara 
not  axaetiy  trua  doaa  not  introduca  any  biaa  into  tha 
ayataoa.  Thay  only  affact  tha  variancaa,  and  to  tha 
axtant  that  thay  ara  inaccurata,  tha  praciaion  aay  ba 
•lightly  affact ad. ) 


2.3 


»-r  >-<a->-»«.v-<  wa*  I 


Par  tha  Span  1  ah  aumaaa  altamativa,  wa  divlda  tha 
sampling  fraaa  into  "thraa  atrata,  vhara  atratua  1  conaiata  of 
Puarto  Rico,  atratua  2  conaiata  of  Donnallay 'a  list,  and  atratua 
3  ia  tha  raaaindar  of  tha  Hiapanica  in  tha  Uni tad  Stataa. 


Lat  ba  aqual  to  tha  aaapla  aiza  (nuabar  of 
intarvlawa)  in  atratua  i,  i-1,2,3.  Also,  daflna 

Cx  -  coat  of  acraaning  ona  housahold 
C2  “  coat  of  intarv laving  ona  paraon,  and 
C  -  total  cost 


Tabla  2.1  suaaarizaa  tha  charactariatica  of  tha  thraa  strata 
baaad  on  population  and  sampling  cost  diatrihutiona . 


A- 3  3 


’abla  2-1.  Discrlbueion  of  cha  Hispanic  population,  uaplt 
and  eoae  by  seracua 


Seracua  | 

Screening  | 
Baca1  | 

*  of 

Populaeion4 

|  Hunter  of 
|  Inearvtsw* 

1  , 

|  Cose  (C)J 

1/Puareo  Bico 

3.33 

.19 

al 

3 . 33n^C^  ♦ 

2/Spanish  sumaaa 

4.83 

.36 

“2 

4 ,  SSn^^  •  2 . 16n^C^^n2C2 

3 /Ochar 

78.07 

.43 

°3 

140 . 

Sc  r  sailing  racaa  ara  eoapucad  basad  an  eha  follow  in*  formula: 

Screening  Baca  -  screening  raea  for  Hispanic  households  z 
»craaning  rac a  for  ana  eligible  parson. 

2Tba  population  eonaiscs  of  Son- Prior -Sarrlca  (STS)  Hispanic  sales  between 
co  24  years  of  aga  in  ealaphoaa  houaaholda . 

3Tha  BOO  saapla  (excluding  Puerto  ti.co)  will  includa  cha  saapla  of  ochar 
Hiapaaica  (a*)  plua  soaa  of  eha  Spanish  sumaaa  saapla  (nj) .  Therefore,  to 
caaplaeO'  n-j  Lnearwiaws  for  cha  third  acrseua  wa  naad  co  seraan  aora  Hispanics 
in  eha  general  BOO.  Ae  cha  saana  etna,  sinca  wo  harm  alraady  saaplad  soaa  of 
cha  Spanish  sum  ana  scxacun  in  eha  BOO,  wa  do  not  naad  to  seraan  as  such  to 
gee  n,  incarwiawa  for  eha  sacond  scraeun.  Thus,  cha  coac  of  sas^ling  oj 
eligible*  froa  eha  Spanish  sumaaa  seracua  is  givan  by 

4.83(02  •  34  *  "2C2  - 

and  cha  coac  of  sanpling  nj  aligibias  froa  eha  chird  serscun  is  aqual  co 


.38  ♦  .43 


Let  x  denote  an  es ci.ua ted  mean  far  the  Hispanic 
population,  x  is  given  by 

x  *  .19  it  ♦  .36  x2  *  .45  xj, 

where  Xi_  is  the  estimated  mean  for  stratum  i,  i=L,2,3.  Since  the 
sampling  variances  of  the  three  strata  are  assumed  to  be  equal, 
the  sampling  variance  of  x  is  given  by 


(  .19) 


2  <3 


,2  a 


2  a 4 


X-  *  ( .36)*  i-  ♦  ( .45)*  5- 

®1  ^2  ^3 


The  total  cost  of  interviewing  n^  males  within  stratum 
i.  i»l,2,3,  is  given  by 


C  ■  (3.53^  *  4.3Sn2  ♦  138.37n3)  CL  +  (nj.  ♦  n2  *  n3 1  C2 


We  want  to  achieve  the  desired  precisian  in  the 
estimate  x  at  minimum  eest  where  the  precision  is  what  would  have 
resulted  from  a  simple  random  sample  of  2,000  cases.  Thus,  we 
minimize  the  above  equation  subject  to  the  constraint 


x 


2000 


The  results  of  the  optimization  procedure  is  given  in  Table  2-2 
for  various  values  of  C2/C^ 


3.  CHARACTERISTICS  CS  AREA  STRATIFI CATION 


3 . 1  Basic  garawsters 

Tha  following  tails  shows  tha  availahla  information  on 
tha  concentration  of  Hispaaics  by  Ctnsus  tract  in  1970,  and 
wsstae's  estimates  of  ths  lUcsly  distribution  of  Hispanics  by 
talapho'na  exchange. 

Tula  1-1.  9.9.  Maaaatia  aiacrlMtloa  »y  "■■»m  rraata*,  1*79  M 

tniMtw  almritmtiaa  #v  T«l  ■*«—  Osaanfaa 


Tula  1-1.  Olacrifiutioo  at  t&a  dlapanic  population,  au(U,  uM  aaapilnq  coat  by  acracua 


'abla 

3  -  3 .  opt  lama 

Joe  tba 

saapla  nzas  and  tha  asaoci acad  screan.r.q 
tru  jtratiiicatioa  roacAod  by  C2/C; 

KuoMr  o e  iatarviawa  (a^i 

s'!;:*.: 

:2/Ct 

l4ii  uu 

10% 

10-29* 

30-39% 

$0  \  or 
nor* 

?uarto  also 

Toca* 

i 

163 

733 

638 

714 

1.269 

3,544 

3 

173 

733 

399 

611 

970 

3 ,103 

10 

133 

743 

362 

342 

916 

2.348 

13 

134 

731 

334 

301 

734 

2.594 

20 

202 

722 

517 

474 

681 

2.596 

23 

203 

714 

502 

432 

644 

2 .  521 

a 

440 

360 

340 

280 

380 

2.300 

?afel«  3-3.  OBClaoa  aaapla  aisaa  ud  t&a  iMoeUttd  acraaninq  »«sr*j 
far  ta»  um  rtxmtlllcatlaa  aatdod  by  C2/C1  (contlauad) 


Aaount  at  acraaaiaq  rltH  aa 
allowaaca  or  20*  aenraapoaaa 


<V«i 

Laaa  *-flan 

10* 

10-29* 

30-69* 

60  *  or 

Tuarto  JUca 

Total 

1 

49,374 

23,379 

9,823 

3,307 

3,092 

113 , 181 

3 

73 , 379 

33,221 

9,233 

4,713 

3,892 

114,636 

10 

77,7*3 

22, 913 

1,663 

4,190 

_ 3,274 

116.911 

13 

*1,367 

22,342 

6,230 

3,864 

2,943 

119,149 

20 

*4,931 

22,263 

7,968 

3,636 

3,733 

131,333 

23 

*7,874 

22,019 

7,737 

3,488 

u 

u» 

• 

♦* 

123 , 699 

184,998 

17.269 

9,341 

3,160 

1,333 

211,193 

39 
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4.  RELATIVE  2FFTCIZNCY  QT  AREA  STRATIFICATION 
COMPARED  TO  THE  SPANISH  SURNAME  ttETHCD 


If  we  compare  tiis  screening  aumbars  for  the  Spanish  sux- 
oaM  method  as  given  In  Table  2-2  with  those  for  area  stratifica¬ 
tion  in  Tahla  3-3  we  saa  that  tha  total  screening  la  such  higher 
for  araa  stratification  than  for  tha  Spanish  aurnama  method.  To 
gat  a  better  idaa  about  tha  relative  efficiency  of  tha  two  meth¬ 
ods  baaad  on  sampling  costa  «a  compute  tha  cost  ratio  which  is 
tha  ratio  of  coat  for  a  method  divided  by  cost  baaad  on  straight 
ROD  ( straight  rdd  ia  tha  third  alternative  as  given  la  tha 
introduction) .  wa  hava  traatad  ?uarto  Rico  separately  sinca  it 
has  diffarant  charactarlatlca  than  tha  rast  of  tha  United  States. 
That  ia,  wa  hava  excluded  Puerto  Rica  from  tha  two  alternatives 
and  tha  straight  ROO  whan  wa  camputad  tha  cost  ratios.  Tabla  4-1 
glvas  tha  coat  ratios  to  straight  ROO  for  tha  ewo  alternatives. 


Tabla  4-1  Cost  ratio  to  straight  ROD  (< 
for  tha  two  alternatives 


iludlng  Pusrto  Rico) 


Cost  Ratio  to  straight  ROD 


C2/Ci 

Aroa  Stratification 

Spanish  Surname 

1 

.69 

.64 

5 

.74 

.69 

10 

.78 

.73 

13 

.91 

.79 

20 

.34 

.79 

23 

.96 

.31 

5.  SCREENING  ?CR  HISPANICS  DERIVATION 


The  JAmp ia  sizes  discussed  in  Saccion  1-4  of  this 
memorandum  will  meet  requirements  ( 1 )  to  ( 5 )  for  Hispanics ,  as 
stated  in  the  proposal.  They  will  also  meet  requirement  (6)  for 
Maxican  Americana  and,  for  Puerto  Ricans,  not  for  "other" 
Hispenics.  We  had  anticipated  this  problem  and  in  our  Proposal 
in  response  to  tha  REP,  wa  suggested  that  for  the  first  year  the 
Hispanic -derivation  analysis  be  restricted  to  Mexican- Amer lean 
and  Puerto  Ricans. 

If  either  tha  Spanish  Surname  or  Area  Stratification 
plan  is  followed,  the  proportion  of  Puerto  Ricans  in  tha  sample 
will  be  much  greater  than  their  proportion  in  tha  total  Hispanic 
papulation.  The  reason  is  that  any  optimization  procedure  will 
oversample  eligible  persons  in  Puerto  Rico  because  of  tha  much 
lower  screening  levels  there.  The  approximate  distribution  of 
the  sample  by  Hispanic  derivation  is  shown  below.  ?or  a  number 
of  reasons,  only  approximate  numbers  can  be  developed  at  this 
time.  The  actual  number  of  sample  -ases  in  Puerto  Rico  will 
depend  on  whether  the  Spanish  Surname  or  Area  Stratification 
method  is  used,  and  on  the  estimated  value  of  C2/C1.  However, 
the  value  of  SOO  appears  to  be  a  reasonable  estimate  of  the  final 
value  in  Puerto  Rico,  and  2,300  as  the  total  sample.  In  the  50 
states,  we  have  assumed  the  distribution  of  the  sample  will  be 
proportionate  to  the  numbers  in  the  population.  However,  it  will 
be  also  affected  by  such  factors  as  the  proportions  of  each  group 
with  Spanish  Surname  or  the  degree  they  live  in  areas  with  high 
concentrations  of  Hispanics.  The  figures  below  should  therefore 
be  considered  as  approximations  intended  to  Indicate  where  sample 
sizes  will  create  problems  in  analysis. 


Area  and  derivation 


Sample  Size 


Puerto  Rico 

300 

30  States 

Puerto  Rican 

3400 

Mexican  American 

1109 

Other 

492 

2300 

So  til  the  Puerto  Rican  and  Mexican  samples  are  large 
enough  to  satis*'/  the  precision  requirements  (which  need  a  sample 
o£  603  with  simple  random  sampling  and  about  944  with  the  design 
effects  arising  from  the  alternate  sampling  plans).  The  ’*9ther" 
group  will  only  have  slightly  over  one-half  the  sample  size 
necessary.  It  would  require  doubling  the  screening  effort  to 
attain  the  desired  precision.  Alternately  limited  analysis  can 
be  carried  out  for  this  group.  The  sample  will  permit  as  an 
analyst  to  detect  year-to-year  changes  of  4.0  percent  instead  of 
the  3.0  percent  indicated  in  the  RTP. 
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Attachment 


MEMCBANOUM 

TO:  ~  Honie  Nieva  February  21,  13 a 6 

FHCM:  Layla  Mohadjer 

SUBJECT:  ACCMS  Sample  Design  -•  Alternative  Universes  far  t.-.e 

Hispanic  Sample 


One  of  the  possible  changes  in  the  statistical  objectives  of 
ACCMS  proposed  at  the  Statistical  Advisory  Meeting  of  February  7 
is  to  restrict  the  geographic  area  for  Hispanic  analysis  to  areas 
containing  substantial  number  of  Hispanics.  This  approach  will 
not  produce  a  national  probability  sample,  but  a  sample  of 
Hispanics  living  in  selected  areas  of  the  United  States.  In  thus 
memo,  we  provide  data  on  the  distribution  of  counties  by  numhe 
and  percent  Hispanics  to  assist  ARI  in  reaching  a  decision  on 
cutoff  on  number  or  percent  of  Hispanics  in  a  county,  we  also 
provide  an  estimate  of  the  effect  of  this  change  on  the  total 
number  of  screened  households. 

Table  1  presents  the  1380  distribution  of  the  total 
papulation,  the  Hispanic  papulation,  and  number  of  counties  by 
percent  Hispanic  and  number  of  Hispanics.  This  information  was 
put  together  as  part  of  the  design  of  the  Hispanic  HANES  (Hea.tr. 
and  Nutrition  Examination  Survey)  for  NCHS.  The  cutoff  point  for 
the  Hispanic  HANES  started  with  the  following  exclusions. 

Counties  which  did  not  satisfy  ona  or  more  of  the  following 
criteria  were  excluded  from  the  universe: 


1. 

More  than  30,900  Hispanics,  or 

2. 

20,000-30,000  Hispanics  and  representing  5 
more  of  the  total  county  population,  or 

percent  or 

3. 

10,000-20,000  Hispanics  and  representing  5 
more  of  the  total  county  population,  or 

percent  or 

4. 

5,000-10,000  Hispanics  and  representing  10 
more  of  the  total  county  papulation,  or 

percent  or 

5. 

5,000  or  fewer  Hispanics  but  representing 
percent  of  the  total  county  population. 

15  or  more 

The  counties  which  do  not  meet  these  criteria  fell  in  the 
calls  that  are  printed  in  bold  in  the  upper  left  comer  of 
Table  1.  The  251  counties  Identified  at  this  stage  are  primarily 
located  in  the  five  Southwest  states;  the  New  Yorfc  area,  the 
Chicago  area,  Miami  and  Tampa-St.  Petersburg,  Florida,  areas. 


ft  »1 


Far  the  Hispanic  HAHES  study,  an  additional  20  counties 
consisting  of  all  counties  outside  the  five  Southwest  states,  the 
Hew  York  area,  Chicago  area,  and  Miami  ( Cade  county)  were  a_so 
excluded.  For  this  approach,  the  universe  of  231  counties 
accounts  far  11,633,612  Hispanics  (in  I960)  or  about  30  percent 
of  all  Hispanics  enumerated  in  the  1930  Census. 

Percent  of  Hispanics  in  1930  for  the  four  major  areas  are 
given  in  Table  2.  The  Chicago  area  has  the  lowest  percent  of 
Hispanics  when  compared  to  the  other  areas.  Thus,  an  alternative 
cutoff  point  would  be  to  exclude  the  Chicago  area.  Then  the 
universe  will  account  for  76  percent  of  all  Hispanics  in  the 
United  States.  Another  alternative  is  to  exclude  counties  with 
less  than  5  percent  and  SO, 000  Hispanics.  (This  is  in  addition 
to  the  counties  excluded  from  the  Hispanic  HANES  frame.)  For 
this  option,  the  universe  will  include  about  79  percent  of 
Hispanics.  The  percentages  stated  here  assume  that  Puerto  Rico 
is  not  part  of  the  universe.  Zf  Puerto  Rico  is  part  of  the 
frame,  the  exclusion  of  the  above  will  have  a  smaller  effect  on 
the  percent  of  coverage. 

Table  3  provides  four  options  for  ACCMS  Hispanic  universe. 
The  savings  in  total  screening  are  approximate  numbers  based  on 
the  total  screening  necessary  for  area  stratification  when  the 
universe  consists  of  all  Hispanics  in  the  United  States.  The 
screening  rate  for  one  Hispanic  household  in  the  area 
stratification  was  estimated  to  be  around  21.  The  overall 
screening  rata  for  the  options  stated  in  Table  3  is  about  10. 

That  is,  with  a  universe  that  covers  75  to  30  percent  of 
Hispanics,  the  screening  rata  is  about  one  half  of  the  screening 
rate  in  a  universe  that  includes  all  Hispanics. 

It  should  be  noted  that  the  approximate  coverages  and 
savings  in  total  screening  are  based  on  the  1930  Census  data 
which  is  now  six  years  old.  They  are  also  based  on  several 
assumptions  and  estimations  including  the  distribution  of  the 
proportion  of  Hispanic  households  in  telephone  exchanges  with 
heavy  concentrations  of  Hispanics,  moderate  concentrations,  etc. 
We  are  not  certain  how  close  this  distribution  is  to  the  one  we 
will  find  in  practice.  However,  we  feel  that  the  savings  in 
total  screening  for  Hispanics  will  be  in  the  same  range  as  these 
given  in  Table  3. 

The  options  given  in  Table  3  include  universes  with  75  to  30 
percent  coverage  of  Hispanics.  If  it  is  of  interest  to  ARI ,  we 
will  further  study  other  alternative  universes  with  higher  or 
lower  coverages  (uni verses  with  more  than  30  or  less  than 
75  percent)  or  other  combinations  of  areas. 
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Table  1  Number  and  percent  at  Hixpanica  in  1980  Cor  he  fcmr  treat  in  the  univene 


A« 

Total 

Five 

Sown  west 
Soto 

Cbtcafo 

Dade 

Camay 

New  Yotk 

Tool  populMtoe 

3S_J70,232 

6,033,100 

1.623.300 

13.114.620 

61, 363. *52 

HbpMIC  popujjUOB 

3,4(3,031 

5 69 .3 61 

310.449 

1.991,764 

1 1.633.612 - 

Percent  Hijpema 

22 

9.4 

33.7 

13.2 

19 

I 


I 


A— 4 


Percent  of 
Hispanic  coverage 


Approximate  savings 
in  total  screening 


excluded 


Puerto  Rico 
included 

Puerto  Rico 
excluded 

33 

5,000 

82 

<5.500 

80 

10,000 

79 

11.500 

Puerto  Pico 
included 
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M6MOBANOUM 

TO:  Ronnie  ffiava 


FROM: 


annie  M. 
<y*is 
Joa^/WaJcsbarg 


December  11,  1385 


SUBJECT :  Data  on  College  students  for  ACOMS 


Extracts  from  two  Census  Bureau  reports  that  provide 
data  relevant  to  the  college  student  component  of  ACOMS  are 
attached.  The  first  contains  information  on  the  proportions  in 
"college  housing" (essentially  dormitories  and  fraternities). 

This  ham  some  implications  for  followup  activities.  We  proposed 
to  sample  dormitory  and  fraternity  students  at  their  parents 
residence,  obtain  telephone  numbers  where  they  can  be  reached, 
and  contact  them  at  school.  Students  living  at  home  or  in  other 
ordinary  living  quarters  will  be  sampled  at  their  residences. 

The  Census  report  on  living  arrangements  is  almost  10  years 
old  but,  as  far  as  I  know,  it  is  the  most  recent  report  on  the 
subject.  It  indicates  that  in  1976  about  26  percent  of  all  male 
college  students  24  years  or  younger  lived  in  college  housing. 

In  four  year  colleges,  the  proportion  was  34  percent,  and  for 
undergraduated  in  four-year  colleges  it  was  37  percent.  Although 
the  proportions  have  probably  changed  since  1976,  these  numbers 
give  some  indication  of  the  number  of  cases  for  which  special 
followup  activities  will  be  needed. 

The  second  report  shows  the  1961  breakdown  of  college 
students  24  years  and  younger  in:  two-year  collagee, 
undergraduates  in  four-year  colleges,  and  graduate  students  in 
four-year  colleges.  It  indicates  that  about  26  percent  are  in 
two-year  colleges,  63  percent  are  undergraduates  in  four-year 
colleges  and  universities,  and  11  percent  are  graduate  students. 

It  is  important  to  note  that  we  based  our  estimates  of  the 
screening  levels  necessary  to  achieve  the  required  number  of  two- 
year  and  four-year  college  students  on  the  definitions  of 
enrollment  used  by  the  Census  Bureau  in  its  Currant  Population 
Survey.  For  students  in  four-year  colleges,  enrollment  covers 
both  undergraduate  and  graduate  students,  and  full  and  part  time 
enrollment.  (About  90  percent  of  16-21  year  old  sale  college 
students  attend  full  time;  about  79  percent  of  22-24  year  old 
male  college  students  attend  full  time. )  If  a  sore  restricted 
definition  of  college  students  vers  to  be  used,  the  level  of 
screening  would  have  to  be  increased  considerably. 

I've  also  duplicated  selected  pages  of  the  texts  of  the 
reports  containing  the  definitions  and  question  wording.  I  have 
a  copy  of  the  full  reports,  if  you  want  to  see  them. 

JW:mlp 

ce:  Martha  Berlin 

Ley la  Mohadjer 
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INTRODUCTION 

This  report  presents  information  for  1976  and  earlier  years 
on  the  residence  of  college  students  14  to  34  years  old. 
Changes  in  the  characteristics  of  college  students  during  the 
1970's  have  resulted  in  changes  in  living  arrangements  while 
attending  college.  For  example,  students  in  1976  were  older, 
more  likely  to  be  women,  and  more  likely  to  be  enrolled  In 
2- year  colleges  than  students  enrolled  a  decade  earlier.1  The 
choice  of  living  arrangements  for  college  students  is  in¬ 
fluenced  by  a  variety  of  factors  including  the  amount  and 
cost  of  available  housing,  family  relationships,  marital  status, 
and  the  desire  to  live  independently  from  one's  parents.  The 
increased  level  of  governmental  support  for  collage  costs 
during  the  past  10  years  (such  as  through  the  Basic  Educa¬ 
tion  Opportunity  Grant  Program)  may  be  responsible  for  the 
increased  number  of  students  being  able  to  live  awe y  from 
their  parents  while  attending  college.  This  report  considers 
the  demographic  changes  among  college  students  and  how 
these  changes  have  influenced  their  type  of  living  arrange¬ 
ments  while  attending  college. 

The  data  for  this  report  were  collected  in  the  Current 
Population  Surveys  (CPS)  of  October  1958,  1966,  1971, 
and  1976.  According  to  the  CPS  rules  of  household  member¬ 
ship.  a  family  member  who  was  living  away  from  home 
because  ha  or  she  was  attending  college  but  would  usually 
live  at  home,  is  included  as  a  member  of  the  parents'  house¬ 
hold.  However,  questions  asking  specifically  about  the 
living  arrangements  of  college  students  while  at  college  were 
included  in  the  survey  for  the  years  shown  in  the  report 
(see  definitions  section). 

Some  of  the  major  shifts  between  1958  and  1976  in  the 
choice  of  living  arrangements  while  in  college  are  shown  in 
table  A.  In  1968.  there  were  somewhat  more  college  students 
living  with  their  parents  or  other  relatives  than  either  the 
number  who  were  maintaining  their  own  households  or  the 
number  living  in  collage  housing.  By  1976,  however,  the 

1  U.S.  Bureau  of  the  Census,  Current  Population  Reports,  Series 
P-20.  No.  319,  "School  Enrollment— Social  end  Economic  Charec- 
teristics  of  Students:  October  1976." 


number  of  students  maintaining  their  own  households  had 
risen  sharply  so  that  it  was  about  the  same  as  the  number 
living  with  their  parents,  (about  3  million)  and  was  much 
larger  than  the  number  living  in  college  housing,  (about  2 
million).  The  proportion  of  students  living  with  their  parents 
or  in  college  housing  decreased  from  64  percent  in  1958  to 
54  percent  of  all  students  in  1976.  Thus,  barely  a  majority 
of  college  students  lived  in  “traditional"  living  arrangements 
li.a.,  with  parents  or  in  college  dormitories)  in  1976. 


LIVING  ARRANGEMENTS  OF  UNMARRIED 
COLLEGE  STUDENTS 

About  9  out  of  10  married  students  maintained  their  own 
households  in  each  of  the  survey  years  between  1958  and 
1976,  while  the  living  arrangements  of  unmarried  college 
students  changed  considerably  during  this  time.  For  example, 
in  1958,  about  82  percent  of  unmarried  college  students  14 
to  34  years  old  were  living  in  college  housing  or  with  rela¬ 
tives,  and  only  5  percent  were  maintaining  their  own  house¬ 
holds  (table  B):  by  1976,  the  proportion  in  traditional 
arrangements  had  decreased  to  68  percent  and  the  propor¬ 
tion  maintaining  their  own  household  had  risen  to  15  per¬ 
cent.  Of  course,  older  unmarried  students,  22  to  34  years 
old,  were  more  likely  to  be  maintaining  their  own  households 
than  persons  21  or  younger;  only  5  percent  of  the  unmarried 
men  and  women  students  14  to  21  years  old  had  such  living 
arrangements  in  1976.  The  increasing  age  of  unmarried 
students  has  contributed  to  the  increase  in  these  students 
maintaining  their  own  households.  A  significant  increase 
in  the  proportion  of  unmarried  college  students  maintaining 
their  own  households  occurred  for  both  younger  (14  to  21 
years)  and  older  (22  to  34  years)  students  between  1958 
and  1976  (table  B). 

Even  though  more  college  students  are  living  on  their 
own,  parents  have  remained  a  very  important  source  of 
support  for  unmarried  students  by  providing  housing  and 
other  necessities.  About  4  out  of  10  of  the  urvnarriad  stu¬ 
dents  (14  to  34  years  old)  lived  with  their  parents  or  other 
relatives  while  attending  college  in  1976.  The  proportion 
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Table  1.  Living  Arrangements  of  College  Students  14  Years  Old  and  Over,  by  Type  of  School,  Age,  Sex, 
and  Race:  October  1976 
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Appendix  A.  Definitions  and  Explanations 


Population  coverage.  The  figures  shown  are  for  the  civilian 
noninstitutional  population. 

Symbols.  A  dash  (-)  represents  zero  or  rounds  to  zero,  and 
the  symbol  "8"  means  that  the  base  for  the  derived  figure 
is  less  than  75,000.  An  "X"  means  not  applicable  and  "NA" 
means  not  available. 

Collage  enrollment.  The  college  enrollment  statistics  are 
based  on  replies  to  the  enumerator's  inquiry  as  to  whether 
the  person  was  attending  or  enrolled  in  college  Enumerators 
were  instructed  to  count  as  enrolled  anyone  who  had  been 
enrolled  at  any  time  during  the  current  term  or  school  year, 
except  those  who  have  left  for  the  remainder  of  the  term. 
Thus,  regular  college  enrollment  includes  those  persons 
attending  a  4-year  or  2-year  college,  university  or  professional 
school  (such  as  medical  or  law  school),  in  courses  that  may 
advance  the  student  toward  a  recognized  college  or  uni¬ 
versity  degree  (e.g.  BA  or  MA).  Attendance  may  be  either 
full  time  or  part  time,  during  the  day  or  night. 

Persons  enrolled  in  classes  which  do  not  require  physical 
presence  in  school,  such  as  correspondence  courses  or  other 
courses  of  independent  study,  and  in  training  courses  given 
directly  on  the  job,  are  excluded  from  the  count  of  those 
enrolled  in  school,  unless  such  courses  are  being  counted 
for  credit  at  a  college. 

Students  enrolled  in  the  first  through  fourth  year  of 
college  are  referred  to  as  undergraduates  Those  enrolled  in 
the  fifth  year  of  college  or  higher  are  graduate  students. 

Public  or  private  college.  In  this  report,  a  public  college  is 
defined  as  any  educational  institution  operated  by  publicly 
elected  or  appointed  school  officials  and  supported  by  public 
funds.  Private  colleges  include  educational  institutions  estab¬ 
lished  and  operated  by  religious  bodies,  as  well  as  those 
which  are  under  other  private  control.  In  cases  where  en¬ 
rollment  was  in  a  college  which  was  both  publicly  and 
privately  controlled  or  supported,  enrollment  was  counted 
according  to  whether  it  was  primarily  public  or  private. 

Two-year  and  four-year  college.  Students  enrolled  in  the 
first  3  years  of  college  were  asked  to  report  whether  the 
college  in  which  they  were  enrolled  was  a  2-year  college 
(junior  or  community  college)  or  a  4-year  college  or  uni¬ 
versity.  Students  in  the  fourth  academic  year  of  college  or 
higher  were  assumed  to  be  in  a  4-year  college  or  university. 

Age.  The  age  classification  is  based  on  the  age  of  the  person 
at  the  time  of  the  survey. 
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Race.  The  population  is  divided  into  three  groups  on  the 
basis  of  race:  White,  Black,  and  "other  races.”  The  last 
category  includes  Indians.  Japanese,  Chinese,  and  any  other 
race  except  White  and  8  lack . 

Marital  itatus.  The  marital  status  category  shown  in  this 
report,  "married,  spouse  present,"  includes  persons  who  are 
currently  married  and  living  with  their  spouse.  Persons  re¬ 
ferred  to  as  unmarried  in  this  report  are  never  married, 
separated,  divorced,  or  widowed. 

Family.  The  term  "family,"  as  used  here,  refers  to  a  group 
of  two  persons  or  more  related  by  blood,  marriage,  or  adop¬ 
tion  and  residing  together;  all  such  persons  are  considered 
as  members  of  one  family. 

Head  of  family.  One  person  in  each  family  residing  together 
was  designated  as  the  head.  The  head  of  a  family  is  usually 
the  person  regarded  as  the  head  by  members  of  the  family. 
Women  are  not  classified  as  heads  if  their  husbands  are 
resident  members  of  the  family  at  the  time  of  the  survey. 

Dependant  family  members.  For  the  purpose  of  this  report, 
a  dependent  family  member  is  a  relative  of  the  family  head, 
excluding  the  head's  wife.  Such  persons  are  generally  sons 
and  daughters,  of  the  family  head.  Family  members  who  are 
living  away  from  home  while  attending  college  are  also 
counted  as  dependent  family  members. 

Family  income.  Income  as  defined  in  this  report  represents 
the  combined  total  money  income  of  the  family  before 
deductions  for  personal  taxes,  Social  Security,  bonds,  etc. 
It  is  the  algebraic  sum  of  money  wages  and  salaries,  net 
income  from  self-employment,  and  income  other  than  earn¬ 
ings  received  by  all  family  members  during  the  12  months 
prior  to  the  surveys.  It  should  be  noted  that  although  the 
family  income  statistics  refer  to  receipts  during  the  previous 
12  months,  the  characteristics  of  the  person,  such  as  age, 
marital  status,  etc.,  and  the  composition  of  families  refer  to 
the  date  of  the  survey. 

The  income  tables  include  in  the  lowest  income  group 
those  who  were  classified  as  having  no  income  in  the  previous 
12  months  and  those  reporting  a  loss  in  net  income  from 
farm  and  nonfarm  self-employment  or  in  rental  income. 

The  income  table  in  this  report  include  a  separate  category 
for  families  for  which  no  income  information  was  obtained. 
In  most  of  the  other  Current  Population  Survey  Reports 
showing  income  data,  the  missing  income  data  have  been 
allocated. 
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The  money  income  level  of  families  shown  in  this  report 
may  be  somewhat  understated.  Income  data  from  the  Octo¬ 
ber  control  card  are  based  on  the  respondent  s  estimate  of 
total  family  money  income  for  the  preceding  12  months 
coded  in  broad,  fixed  income  intervals.  Income  data  col¬ 
lected  in  the  March  supplement  to  the  Current  Population 
Survey  are  based  on  responses  to  1 1  direct  questions  asked 
of  all  persons  14  years  old  and  over  identifying  23  different 
sources  of  income  and  cover  the  preceding  calendar  year. 

Previous  research  has  shown  that  the  use  of  broad  income 
intervels  to  record  money  income  tends  to  reduce  the  rate 
of  nonreporting  while  increasing  the  likelihood  that  the 
amounts  reported  will  be  significantly  understated  as  com¬ 
pared  with  results  from  more  detailed  questions. 

Residence  of  college  students.  In  the  Current  Population 
Survey,  persons  living  away  from  home  while  attending 
college  who  are  not  married  and  living  with  their  spouse  are 
counted  as  members  of  their  parental  households.  However, 
the  data  on  living  arrangements  of  college  students  in  this 
report  are  based  on  special  questions  asked  in  the  October 
1976.  1971,  1966.  and  1958  CPS  and  relate  to  the  actual 
place  where  the  students  were  staying  at  the  time  of  the 
survey. 

Information  on  place  of  residence  of  persons  enrolled  in 
college  was  obtained  from  the  following  direct  questions: 
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34.  <W‘'-  col* vy*  Soci  .  .  .  !<*#. 

Ho™  .  2  (FJltOI 

coll*g€  touting  u  41) 

Somoploco  dso  .  .  .  :  UU10I  I 

40.  Wire  oliaoi  4ooo  .  .  .  Moo  wliilo  offending  school? 

0 a,«  OH  cords  o«fyl 

With  paronts  .  C  With  othor -olotivos  C. 

With  husoand.  W'-e  oorwxu 

eifo  or  own  childron  Z  nor  relorod  *0  - 

9y  himsoll/hwsolf 

tSk ro  10  til 
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Interviewers  were  instructed  to  mark  "here"  in  question 

39  if  the  person  was  residing  in  the  sample  unit  being  enu¬ 
merated;  to  mark  "in  college  housing"  if  the  person  lived 
in  a  dormitory,  fraternity,  or  sorority  house  affiliated  with 
the  college  or  university;  and  to  mark  "someplace  else”  if 
the  person  lived  in  any  other  type  of  quarters.  If  the  person 
lived  "here,"  the  interviewers  were  instructed  to  fill  question 

40  in  accordance  with  the  response  to  the  question  on  rela 
tionship  to  the  heed  of  the  households.  For  persons  who 
lived  "someplace  else,"  the  interviewer  asked  question  40 

The  following  types  of  living  arrangements  were  identi¬ 
fied. 

1.  For  persons  living  at  home  ("here”  in  item  39):  Maintain¬ 
ing  own  household  includes  (1)  with  own  family  consist¬ 
ing  of  household  heeds  or  wives  who  live  with  spouse 
and/or  their  own  children  and  (2)  with  nonrelatives  or 
alone  consisting  of  persons  who  were  household  heads 
but  had  no  relatives  present;  they  could  be  living  alone 
or  with  roommates.  In  household  of  parents  or  other 
relatives  includes  persons  who  were  not  household  heads 
or  wives  but  were  classified  as  "other  relative  of  head" 
in  the  household  relationship  item  and  lived  'with  par¬ 
ents"  or  'With  other  relatives"  in  item  40.  With  non- 
relatives  includes  persons  who  were  not  household  heads 
or  wives  and  were  classified  as  living  "with  persons  not 
relat'd  to  him/her"  in  item  40. 

2.  For  persons  living  away  at  college  ("in  college  housing" 
or  "someplace  else"  in  item  39):  in  college  housing 
comprises  students  living  away  from  home  in  college 
dormitories,  or  in  fretarnity  or  sorority  houses,  or  in 
other  buildings  owned  and  operated  by  the  school.  With 
relatives,  with  nonrelativss.  or  slona  include  students 
who  live  away  from  their  parental  home  in  off  campus 
housing  such  as  a  house,  an  apartment,  e  rooming  house 
or  any  other  type  of  housing  unit. 


Rounding  of  estimates.  Individual  figures  are  rounded  to  the 
nearest  thousand  without  being  adjusted  to  group  totals, 
which  are  independently  rounded.  With  few  exceptions, 
percentages  are  based  on  the  rounded  absolute  numbers. 
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Public  or  Private  School  — In  this  report,  a  public  school  is 
defined  as  any  educational  institution  operated  by  publicly 
elected  or  appointed  school  officials  and  supported  by  public 
funds  Private  schools  include  educational  institutions  estab¬ 
lished  and  operatea  by  religious  bodies,  as  well  as  those  which 
are  under  other  private  control.  In  cases  where  enrollment 
was  m  a  school  or  college  which  was  both  publicly  and 
privately  controlled  or  supported,  enrollment  was  counted 
according  to  whether  it  was  primarily  public  or  private. 

Full-Time  and  Part-Time  Attendance  — College  students  were 
classified,  in  this  report,  according  to  whether  they  were 
attending  school  on  a  full-time  or  part-time  basis  A  student 
was  regarded  as  attending  college  full  time  if  he  was  taking 
1  2  or  more  hours  of  classes  during  the  average  school  week, 
and  part  time  if  he  was  taking  less  than  1 2  hours  of  classes 
during  the  average  school  week. 

Modal  Grade  — Enrolled  persons  are  classified  according  to 
their  relative  progress  in  school,  that  is,  whether  the  grade 
cr  year  m  which  they  were  enrolled  was  below,  at,  or  above 
the  modal  lor  typical)  grade  for  persons  of  their  age  at  the 
time  of  the  survey.  The  modal  grade  is  the  year  of  school  in 


which  the  largest  proportion  of  students  or  a  given  age  is 
enrolled. 

Age  — The  age  classification  is  based  on  the  age  of  the  person 
at  his  last  birthday. 

Race  — The  population  is  divided  into  three  groups  on  the  basis 
of  race  — White,  Black,  and  other  races-  The  last  category  in¬ 
cludes  Indians.  Japanese,  Chinese,  and  any  other  race  except 
White  and  Black.  In  this  report,  other  races  is  not  shown 
separately. 

Spanish  Origin  — Information  on  origin  or  descent  was 
obtained  by  asking,  "What  is  (this  person  s)  origin  or 
descent?"  Responses  generally  refer  to  a  person  s  perceived 
national  or  ethnic  lineage  and  do  not  necessarily  indicate  the 
country  of  birth  of  himself  or  his  parents. 

Persons  of  Spanish  origin  are  persons  who  reported  them¬ 
selves  as  Mexican  American,  Chicano,  Mexican,  Mexicano. 
Puerto  Rican,  Cuban,  Central  or  South  American,  or  other 
Spanish  origin  However,  all  persons  who  reported  themselves 
as  Mexican  American,  Chicano,  Mexican,  or  Mexicano  were 
combined  into  the  one  category —  Mexican.  Persons  of 
Spanish  origin  may  be  of  any  race. 


WESTAT 


Attachment  7 


MEMORANDUM 


TO: 


FROM: 


ACOMS  File 
Layla  Mohadjer 


December  19,  198 S 
(Revised  January  31,  1986) 


SUBJECT:  ACCMS  Sample  Design  -  Total  Screening  Effort  Cor 
Enlarged  Sample  of  Four-year  College  Students, 
Hispanies,  and  Other  Components  of  the  Sample 


As  part  of  an  earlier  worJc  on  sampling  four-year  college 
students,  we  estimated  that  a  screening  sample  of  about  114,000 
is  necessary  to  produce  a  self -weighting  sample  at  2,400  male, 
JTPS,  four-year  collage  students.  The  initial  screening  sample  of 
70,000  households  for  the  PMS  sample  should  produce  about  1,477 
eligible  four-year  college  students.  An  additional  44,000 
screening  will  then  be  necessary  to  supplement  the  initial  sample 
of  four-year  college  students.  Zn  this  memo  we  study  the 
supplementation  of  four -year  college  students  wnan  simultaneous 
screening  is  carried  out  for  oversampling  Hispanies  »"<)  four-year 
college  students.  Zn  addition,  we  provide  estimates  of  sample 
sizes,  available  from  the  total  screening  effort,  far  the 
subgroups  of  interest  in  the  target  population. 

To  obtain  a  representative  sample  of  four-year  college 
students,  we  divide  the  114,000  screening  sample  to  the  U.s. 
(excluding  Alaska)  and  Puerto  Rico  proportional  to  the  general 
population  in  telephone  households.  We  have  assumed  that  the 
percentage  of  telephone  households  are  the  same  as  those  given  in 
Table  4-3,  page  4-12  of  the  proposal.  On  average,  we  assumed 
that  94  percent  of  the  total  population  in  the  49  states  and 
about  80  percent  in  Puerto  Rico  are  in  telephone  households.  Zt 
follows  that  the  screening  sample  should  be  divided  to  112,638  in 
the  U.S.  and  1,362  in  Puerto  Rico. 


Zn  an  earlier  report  on  oversampling  Hispanies,  we  compared 
two  alternatives  for  oversampling  Hispanies:  (1)  Spanish  surname 
method  and  (2)  area  stratification.  Sections  1  and  2  of  this 
memo  present  the  total  screening  necessary  to  achieve  bath  a 
self -weighting  sample  of  2,400  four-year  college  students  and  a 
sample  of  Hispanies  that  satisfy  the  Hispanic  requirements  for 
the  two  alternatives  (Spanish  surname  and  area  stratification). 
Section  3  compares  the  required  screening  levels  for  the  two 
alternatives  for  some  sampling  cost  ratios.  Section  4  gives  the 
estimated  sample  sizes,  available  from  -re  total  screening 
effort,  for  the  sample  components  in  the  study. 
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1.  Supplementation  of  Four-year  College  Students  when 
-  Spanish  Surname  Method  is  Applied 

For  ehis  alternative  we  use  a  dual-frame  approach  to  sample 
both  from  the  Donnelley  list  (refer  to  the  Hispanic  report  for 
information  about  Donnelley  list)  of  Spanish  surnames  and  RDD  to 
obtain  a  sample  of  Hispanics.  Since  Puerto  Rico  does  not  require 
the  substantial  screening  effort  to  locate  Hispanics  that  occurs 
in  the  rest  of  the  United  States,  it  is  treated  as  a  separate 
stratum.  Thus,  this  design  consists  of  three  strata:  Puerto 
Rico,  the  Spanish  surname  list,  and  other. 

The  following  table  gives  the  amount  of  screening  required 
to  select  a  sample  of  Hispanics  that  satisfies  the  Hispanic 
requirements.  This  table  was  given  as  part  of  Table  2-2  in  the 
report  on  oversampling  Hispanics. 

Table  1.  Amount  of  screening  for  the  Spanish  surname  alternative 
with  in  allowance  of  20  percent  nonresponse 


5.198 

4,064 

3.455 

3,120 

2.903 

2,745 


10,549 

8,409 

7,072 

6,280 

5,728 

5,318 


aa,3sa 

93,452 

98,371 

102,236 

105,398 

108,032 


104,105 

105,925 

108,898 

111,636 

114,029 

116,095 


*c2/cl  the  cost  ratio  of  interviewing  one  person  to  screening 
one  household. 


To  obtain  screening  levels  given  in  Table  1  for  the  Hispanic 
sample,  the  114,000  screening  sample  for  four-year  college 
students  needs  to  be  increased  in  Puerto  Rico  and  Spanish  surname 
strata.  It  should  be  noted  that  the  Donnelley  list  consists  of 
about  2.1  million  Spanish  surname  households.  If  we  assume  a 
10  percent  loss  for  reasons  such  as  telephone  number  missing, 
moved,  ate.,  then  about  1.89  million  of  telephone  households  in 
the  U.S.  are  on  Donnelley  list  (Spanish  surname  stratum).  That 
is,  about  2.4  percent  of  total  telephone  households  in  the  U.S. 
are  in  the  Spanish  surname  stratum.  (The  total  telephone 
households  for  the  49  states  in  1984  is  estimated  to  be  about 
79,893.)  Thus,  it  is  expected  that  out  of  112,638  screening  in 
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the  u.s.  for  four-year  college  students  about  2,665  will  be  in 
the  Spanish  surname  stratum,  table  2  gives  the  additional 
screening  in  Puerto  Rico  and  Spanish  surname  strata  necessary  for 
the  Hispanic  sample,  the  last  column  of  table  2  shows  the  total 
screening  required  Cor  oversampling  four-year  college  students 
and  Hispanics  when  Spanish  surname  method  is  applied. 


i 

table  2. 


total  screening  required  for  oversampling  four-year 
college  students  and  Hispanics  when  the  Spanish  surname 
methods  is  applied 


c2/cL 

Additional  screening 
for  the  Hispanic  sample 

Total  simultaneous 
screening  for  4-yr 
college  students 
and  Hispanics 

Puerto  Rico 

Spanish  surname  Total 

1 

3,836 

7,884 

11,720 

125,720 

5 

2,702 

5,744 

3,446 

122,446 

10 

2,093 

4,307 

6,500 

120,500 

15 

1,758 

3,615 

5,373 

119,373 

20 

1,541 

3,063 

4,604 

118,604 

25 

1,383 

2,653 

4,036 

118,036 

2.  Supplementation  of  Four-veer  College  Students  when  Area 
Stratification  for  the  Hispanic  Sample  is  used 

For  this  alternative,  we  stratify  the  population  to  identify 
areas  with  heavy  concentration  of  Hispanics  and  oversample  the 
designated  areas  subject  to  a  fixed  precision  for  sample 
estimates.  The  five  strata  are: 


Stratum  1  * 

Stratum  2  ■ 
Stratum  3  ■ 
Stratum  4  a 
Stratum  5  * 


areas  in  the  49  states  with  less  than 
10  percent  Hispanics ; 

areas  with  10  to  29  percent  Hispanics; 

areas  with  30  to  59  percent  Hispanics; 

areas  with  60  percent  or  more  Hispanics;  and 

Puerto  Rico. 


Table  3  gives  the  amount  of  required  to  select  a  sample  of 
Hispanics  that  meets  the  Hispanic  requirement.  This  table  was 
given  as  part  of  Table  3-3  in  the  report  on  oversampling 
Hispanics . 
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Table  3.  Amount  of  screening  for  the  area  stratification  method 
~  with  an  allowance  of  20  percent  nonresponse 


■C2/Ci  is  the  cost  ratio  of  interviewing  one  person  to  screening 

Using  the  entries  of  Table  3-1  of  the  Hispanic  report,  we 
can  estimate  the  total  U.S.  population  in  strata  1  to  4.  The 
112,638  screening  far  the  four-year  college  students  is  then 
distributed  aver  strata  1  to  4  proportional  to  the  population  in 
the  strata.  Table  4  gives  the  screening  samples  for  the  four 
strata. 

Table  4.  Distribution  of  the  screening  sample  for  the  four-year 
college  students  for  area  stratification  method  in  the 
U.S.  (excluding  Puerto  Rico) 


Stratum/% 

Hispanics 

Estimated  percent 
of  population 

Amount  of 
screening 

<10 

.88 

99,122 

10  -  29 

.08 

9,011 

30  -  59 

.03 

3,379 

>60 

.01 

1,126 

comparing  the  screening  levels  in  Table  4  with  those  of 
Table  3,  we  note  that  the  114,000  screening  sample  for  four-year 
college  students  naeds  to  be  increased  in  strata  2,  3,4  and 
Puerto  Rico  to  produce  a  Hispanic  sample  that  satisfies  Hispanic 
requirements.  Table  5  shows  the  total  screening  required  for 
oversampling  four-year  college  students  and  Hispanics  when  the 
area  stratification  method  is  applied. 


Puerto 

C2/Ci* 

<10% 

10-29% 

30-59% 

60%+ 

Rico 

Total 

1 

69,374 

23,375 

9,833 

5,507 

5,092 

113,181 

Si 

5 

73,579 

23,221 

9,232 

4,712 

3,892 

114,636 

.J 

10 

77,783 

22,912 

8,662 

4,180 

3,274 

116,311 

fit 

15 

81,567 

22,542 

8,230 

3,864 

2,945 

119,148 

9 

20 

84,931 

22,265 

7,968 

3 , 656 

2,733 

121,553 

*’ 

25 

87,874 

22,018 

7,737 

3,486 

2,584 

123,699 

-v-'. 
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Table  5.  Total  screening  required  Cor  oversampling  four-year 
-  college  students  and  Hispanics  when  the  area 
stratification  is  used 


C2/Ci* 

Additional  screening  for 
Hispanic  sample 

Tc 

< 

stal  simultaneous 
screening  for 
four-year  college 
students 
and  Hispanics 

Stratum 

2 

Stratum 

3 

Stratum 

4 

Puerto 

Rico 

Total 

1 

14,364 

6,454 

4,381 

3,730 

28,929 

142,929 

5 

14,210 

5,353 

3,586 

2,530 

26,179 

140,179 

10 

13,901 

5,283 

3,054 

1,9X2 

24,150 

138,1.50 

15 

13,531 

4,851 

2,738 

1,583 

22,703 

136,703 

20 

13,254 

4,589 

2,530 

1,317 

21,744 

135,744 

25 

13,007 

4,358 

2,360 

1,222 

20,947 

134,947 

3.  Total  Simultaneous  Screening  Levels  for  Oversampling  Four- 

Vear  College  Students  and  Hispanics 

The  last  columns  of  Table  2  and  5  give  the  total 
simultaneous  screening  levels  for  four-year  college  students  and 
Hispanics  whan  the  Spanish  surname  and  area  stratification 
methods  are  applied,  respectively.  If  we  can  assume  that  the 
cost  of  interviewing  a  person  to  the  coat  of  screening  a 
household  is  between' S  to  1  and  10  to  1  (that  is, 
between  5  and  10 ) ,  then  with  the  Spanish  surname  we  need  to 
screen  121,000  to  123,000  households  and  for  the  area 
stratification  the  screening  sample  is  between  138,000  and 
141,000. 

4.  Estimated  Sample  Sizes.  Available  from  the  Total  Screening 

Effort,  for  the  Suboopulatrons  of  Interest 

To  estimate  the  available  sample  sizes,  we  assume  that  the 
total  screening  sample  is  equal  to  123,000;  4,064  in  Puerto  Rico, 
5,744  in  the  Spanish  surname  list,  and  the  rest  in  the  49  States. 
This  is  equivalent  to  using  the  Spanish  surname  method  when  Cj/C^ 
is  equal  to  5.  We  have  also  assumed  that  the  Spanish  surname 
list  will  only  be  used  to  screen  for  Hispanics.  (We  do  not  plan 
to  use  the  list  to  screen  for  other  sample  components  such  as 
four-year  or  two-year  college  students . )  Table  6  shows  the 
estimated  sample  sizes  and  number  of  interviews  for  various 
subpopulations  of  interest  when  a  screening  sample  of  123,000  is 
used. 


A-63 


Memorandum 


December  13,  1335 
(Revised  January  31,  1386) 


The  123,000  screening  effort  will  provide  the  sample  si2es 
needed -to  achieve  the  required  precision  for  all  the  target 
subpopulations  in  the  study  exeepe  the  Vo-Tech  group.  We  plan  eo 
use  a  two-stage  sampling  scheme  to  select  a  sample  of  Vo-Tech 
students  from  a  list  of  Vo-Tech  schools.  A  memo  describing  the 
sampling  design  for  the  Vo-Tech  subpopulation  will  be  developed 
in  the  near  future. 

The  total  screening  effort  will  increase  to  141,000  if  the 
area  stratification  method  >s  used  to  sample  Hispanics.  As  shown 
in  Table  S,  the  additional  screening  will  be  carried  out  in  areas 
with  a  heavy  concentration  of  Hispanics.  The  total  sample 
available  for  same  components  of  the  sample  such  as  PMS ,  FS ,  SMS , 
and  BlacJcs  will  be  somewhat  higher  than  those  given  in  Table  6. 
However,  the  additional  screening  will  not  result  in  a 
significant  increase  of  the  four-year  college  students  in  the 
screening  sample. 

The  va-Tech  sample  includes  high  school  graduates  only.  It 
is  assumed  chae  30  percent  of  all  Va-Tech  students  who  are  male 
and  between  16  and  24  years  of  age  are  high  school  graduates. 

This  assumption  is  based  on  the  information  provided  in  Joe 
Waksberg's  memo  on  Vo-Tech  Sample  for  ACOMS,  dated  December  17, 
1335.  The  Vo-Tech  sample  excludes  students  who  are  enrolled  in 
college  and  working  toward  a  vocational  certificate.  It  includes 
those  who  are  enrolled  in  a  noncollegiate  environment  such  as 
vocational,  trade,  technical,  business  or  conuercial  schools,  and 
private  -business  or  industry,  community  organization,  and 
government.  The  Westat  proposal  for  this  study  recommended  a 
d-;al- frame  approach  with  part  of  the  sample  generated  in  the  HDD 
sample  and  part  selected  by  going  to  a  sample  of  vo-Tech  schools. 
In  the  memo  on  Vo-Tech  Sample  for  ACQMS,  dated  December  17,  1335, 
Joe  waksberg  proposes  the  use  of  a  single  frame  ( the  va-Tech 
school  sample  only)  for  this  component  of  the  study.  In  that 
case,  the  30  unduplieatad  interviews  for  the  Vo-Tech  sample 
should  be  excluded  from  Table  6. 


Memorandum 


-7- 


December  19,  1985 
(Revised  January  31,  1986) 


Table  6.  Preliminary  estimates  of  sample  sizes  available  from 
123,000  screening 


Total 
sample 
available 
from  123,000 
screening 

Sample  available 
with  an  allowance 
of  20%  nonresponse 

Undupli¬ 
cated 
number 
of  inter¬ 
views1 

Sample 

component 

Number  of 
potential 
respondents 

Number 

of 

interviews 

PMS 

20,780 

16,620 

9,603 

9,603 

FS 

20,780 

16,620 

1,953 

1,953 

Influeneer 

41,560 

33,240 

11,556 

11,556 

Slack  Non- 

Hispanic 

2,740 

2,190 

1,360 

— 

Hispanic 

3,960 

3,170 

3,170 

2,500 

SMS 

3,190 

2,550 

350 

850 

Enrolled  in 

School: 

4-yr  college 

3,020 

2,420 

2,400 

930 

2-yr  college 

1,430 

1,140 

700 

Vo-Tech 

300 

240 

ISO 

Convenience 

720 

580 

5203 

520 

^The  sample  of  9,603  PMS  will  include  approximately  1,150  alack 
non-Hispanics ,  470  Hispanics,  1,470  four-year  college,  700  two- 
year  college,  and  150  Vo-Tech  students.  The  SMS  sample  will 
include  about  200  Hlspanics  and  200  black  non-Hispanics. 

2We  have  assumed  that  a  single  frame  (a  list  of  Vo-Tech  schools) 
will  be  used  to  sample  Vo-Tech  students. 

3The  available  580  potential  respondents  will  provide  a  self¬ 
weighting  sample  of  about  520. 
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Roaie  Nleva 
Ley la  Mohadjer 


A 


June  25,  1986 


Subject:  ACOMS  Sample  Design  -  Data  Collection  and  sample 
weighting  for  Monthly  Reports 


The  purpose  of  this  memo  is  to  describe  the  source  of 
monthly  samples  and  to  review  several  options  available  for 
weighting  the  sample  data  for  the  production  of  monthly  reports. 
The  options  discussed  here  involve  weighting,  partially 
weighting,  or  not  weighting  the  sample  data.  The  options  differ 
with  respect  to  statistical  quality  of  the  estimates  made  from 
the  monthly  data,  and  the  cost  (in  terms  of  time)  of  the 
application  of  each  to  the  monthly  samples.  Since  the  discussion 
involves  the  weighting  methodology  we  plan  to  use  for  quarterly 
and  »»rnial  reports  for  ACOMS,  a  brief  description  of  the  steps 
involved  in  weighting  is  also  provided. 

Monthly  Data  Collection 


We  will  use  the  interviews  conducted  during  a  calendar 
month  for  the  monthly  tabulations,  rather  than  the  sample 
designated  for  the  month.  The  last  couple  of  weeks  of  data 
collection,  which  is  dona  after  the  end  of  the  calendar  month, 
will  be  included  in  the  following  month's  tabulations.  It  should 
be  noted  that  the  first  month '  s  sample  will  be  a  truncated  one 
since  it  does  not  include  any  carryover  from  the  previous  month. 

The  modified  WaJcsberg  method  will  be  used  to  sample 
households  in  selected  clusters.  The  standard  method  involves 
choosing  an  egual  number  of  households  within  each  cluster .  when 
this  method  is  followed,  all  residential  telephone  numbers  have 
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the  sum  chance  at  selection  and  thus,  the  sample  is  a  self- 
weighting  sample.  The  need  t or  a  constant  number  of  households 
per  cluster  requires  a  rather  cumbersome  series  of  steps.  Until 
all  call-backs  have  been  made  for  a  telephone  number,  there  is  no 
way  to  know  if  an  additional  household  is  needed.  There  are  thus 
built-in  delays  which  make  ie  difficult  to  use  the  procedure  for 
the  ACCMS  study  with  the  tight  time  schedules  for  data 
collection. 


The  modified  waksberg  method  is  simpler,  can  be  carried 
out  in  less  time,  and  is  also  unbiased  (in  the  same  sense  as  the 
original  method) .  The  modified  method  does  speed  up  the  data 
collection,  but  at  the  price  of  an  increase  in  sampling 
variances.  The  sample  requires  weighting  far  tha  production  of 
unbiased  estimates;  and  the  variation  in  waights  increase  the 
sampling  variances.  Our  experience  with  this  method  is  that  the 
increase  in  variance  is  in  the  range  at  10  percent. 

$arajq  waisfttjflq 

Sample  weighting  for  quarterly  and  annual  data  will  be 
accomplished  in  throe  steps.  Tha  first  two  steps  involve 
computation  of  weights  to  compensats  for  unequal  probabilities  of 
selection  at  the  household  and  the  person  lavel.  The  third  uses 
post-stratification  (also  referred  to  as  ratio-estimation)  to 
compute  weights  that  adjust  for  sample  nonresponse,  and 
uncoverage  of  nontelephone  households,  as  well  as  to  reduce 
sampling  error.  The  following  gives  a  brief  description  of  each 
step. 


Sampling  rate  adjustments  at  the  household  level 

Households  have  different  probabilities  of 
selection  in  the  modified  Waksberg  method.  In 
this  approach,  a  constant  number  of  telephone 
numbers  per  cluster  (rather  than  of  households  as 
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in  the  standard  needed)  is  selected.  As  a  result, 
the  rate  at  which  a  houser.ald  is  sampled  depends 
an  the  proportion  of  telepaane  numbers  that  are  in 
households  in  the  cluster  in  which  the  household 
is  located.  To  avoid  potential  biases,  a  weight 
will  be  attached  to  each  cluster  whicn  is  the 
average  number  of  sample  households  -er  cluster 
divided  by  the  number  found  in  the  particular 
cluster. 

Furthermore,  households  with  two  telephones  have 
twice  the  chance  of  selection.  Thus,  they  will  be 
given  a  weight  of  1/2  to  adjust  for  this 
overr epr esentation . 
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The  ACCMS  survey  design  calls  for  sampling  various 
population  subgroups  at  different  rates.  Hispanic 
males  will  be  oversampled  and  females  will  be 
undersampled,  weighting  will  be  done  to  adjust 
for  these  unequal  probabilities  of  selction. 


Fast-stratification  will  be  used  to  reduce 
sampling  error,  to  minimize  biases  arising  from 
the  fact  that  nonrespondents  may  be  different  from 
those  who  respond,  and  to  adjust  for  nontslephone 
households  missing  from  the  sampling  frame.  Post- 
stratification  will  be  accomplished  by 
superimposing  weights  on  the  first  two  stages  of 
weighting  chat  will  create  agreement  between  ACCMS 
tabulations  and  Census  data  on  the  total 
population  by  age,  sex,  race  and  Spanish  heritage. 


we  have  considered  the  following  three  options  for 
preparation  of  monthly  sample  data.  Option  1  is  to  weight  the 
data  based  on  the  above  three  stepe  and  use  the  weighted  counts 
for  the  construction  of  tables  for  monthly  reports.  This  option 
will  provide  the  meet  accurate  data.  We  estimate  it  will  take 
about  one  and  a  half  weeks  to  prepare  tabulations  with  ail  three 
stages  of  weighting.  Our  estimate  is  based  on  the  assumption  that 
about  >0  to  90  percent  of  data  cleaning  and  editing  will  be  done 


grow* 


at  the  time  of  interviews  and  no  extensive  data  checking  will  be 
required  for  monthly  samples.  Soma  data  checking  may  be  dene  fer 
quarterly  samples  if  necessary .  Option  2  is  to  partially  weight 
the  data:  that  is,  to  complete  steps  1  and  2  of  the  weighting 
process  for  monthly  samples.  This  will  reduce  the  amount  of  time 
required  for  the  preparation  of  monthly  reports  by  a  day  or  two. 
At  the  same  time,  however,  it  will  reduce  the  reliability  of  the 
statistics  computed  from  the  sample  since  no  adjustments  will  be 
applied  to  the  data  for  nonresponse,  and  uncoverage  of 
nontelephone  households;  and  sampling  errors  will  be  higher. 
Option  3  is  to  use  the  unweighted  data  for  the  monthly  reports. 
This  option  is  applicable  only  if  time  is  the  most  important 
factor  in  the  preparation  of  monthly  reports,  with  this  option, 
it  probably  will  take  about  a  week  to  prepare  frequencies. 
However,  statistics  using  unweighted  counts  will  be  very  rough 
estimates  and  will  have  very  limited  uses.  The  following 
provides  a  description  of  the  main  feature  of  each  option. 

Option  1  will  provide  the  moat  accurate  data,  we 
should  note,  however,  that  even  this  option  will  be  subject  to 
fairly  high  sampling  errors  because  of  the  small  monthly  sample 
sires.  Also,  the  average  of  estimates  of  a  statistic  computed 
from  monthly  samples  will  generally  not  be  equal  to  the  estimate 
made  from  quarterly  or  annual  samples  although  the  differences 
will  usually  be  small.  (Zn  this  memo,  whenever  we  talk  about 
averages,  we  mean  averages  that  take  into  account  differential 
sample  sires  of  monthly  data. )  The  reason  is  that  for  monthly 
data,  sample  sires  for  some  subgroups  of  the  population  will  be 
too  small  for  post-stratification  by  the  associated 
characteristic  (variable),  e.g. ,  Sde  regions.  Therefore,  only  a 
few  variables  can  be  used  for  post-stratification  adjustments  by 
month.  Quarterly  samples  are  three  times  larger  than  monthly, 
samples,  and  thus  can  be  post-stratified  by  more  variables  than 
those  used  for  monthly  samples.  As  a  result,  adjustments  made  to 


monthly  samples  will  be  different  from  quarterly  samples.  The 
same  argument  is  true  far  quarterly  versus  annual  data.  The 
unequal  weights  will  result  in  monthly  estimates  that  do  not 
average  to  the  quarterly  estimate  ( and  quarterly  estimates  that 
do  not  quite  average  to  the  annual  estimate).  Since  quarterly 
samples  will  be  adjusted  for  more  variables  in  the  post- 
stratification  step  than  monthly  samples,  their  averages  will  be 
close  to  the  annual  estimates.  The  differences  between  the 
monthly  estimates'  averages  and  the  quarterly  ones  will  be 
greater,  the  difference  will  both  depend  on  the  distribution  of 
nonresponse  across  papulation  subgroups  and  on  sampling  errors. 

Option  2  does  cot  include  adjustments  for  nontslephone 
households  and  does  not  compensate  for  nonresponse  as  well  as 
option  1.  Monresponse  generally  can  be  expected  to  vary  by 
population  groups  and,  thus,  tends  to  distort  the  distribution  of 
the  sample.  Post-stratification  compares  the  distribution  of 
population  and  sample  across  selected  variables  and  computes 
sample  weights  to  make  sampling  proportions  on  key 
characteristics  reflect  known  papulation  proportions,  when  post- 
stratification  is  not  applied  to  the  data,  the  distribution  of 
the  sample  (by  age,  sex,  race,  etc  may  be  very  different  from 
the  population,  increasing  the  sampling  errors  and  introducing 
the  possibility  of  increased  bias. 

Furthermore,  ROD  does  not  include  nontelephone 
households.  It  is  clear  that  certain  types  of  households  are 
underrepresented  in  telephone  surveys,  e.g. ,  Slack,  low  income, 
etc.  Although  post-stratification  may  not  completely  eliminate 
biases  arising  from  incomplete  coverage,  it  can  be  effective  in 
sharply  reducing  their  effect. 

Option  3  will  produce  the  least  accurate  estimates  when 
coeipared  to  1  and  2.  This  option  neither  adjusts  for  nonresponse 
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and  nontelephone  households,  nor  for  unequal  probabilities  of 
selection  ae  tha  household  and  the  person  level.  Households  wish 
two  telephone  numbers  have  twice  the  chance  o f  selection  and  will 
be  overrepresented  in  the  monthly  samples  by  a  factor  of  2  to  1. 
It  can  be  noted  that  two  telephone  households  are  almost 
certainly  different  from  others.  They  generally  have  higher 
incomes.  Another  reason  for  having  two  phones  is  that  a  member 
of  the  household  is  operating  a  business  service  from  the  home. 
These  unusual  features  will  be  overrepresented  in  estimates  if 
Option  3  is  used.  Even  more  important  is  the  fact  that  this 
option  does  not  adjust  for  the  fact  that  the  rate  at  which  a 
household  is  sampled  depends  on  tha  proportion  of  telephone 
numbers  in  the  cluster  in  which  the  household  is  located. 
Households  in  clusters  that  are  rather  sparsely  filled  are  likely 
to  be  different  from  those 'in  densely  filled  clusters.  They  are 
more  often  rural,  in  suburban  areas  that  are  first  being 
developed,  in  locations  where  there  are  many  businesses  mixed 
with  residential  units,  ate.  These  types  of  households  will  be 
undersampled  with  Option  3.  Finally,  since  no  adjustment  will  be 
made  for  oversampled  Hispanics  and  usdersamplad  females.  Option  3 
will  overrepresent  Hispanics  and  underrepresent  females. 

This  option  will  simply  use  eha  unweighted  (raw)  data 
to  compute  frequencies  for  monthly  reports.  As  noted  earlier, 
estimates  of  statistics  made  from  unweighted  data  from  complex 
samples  such  as  tha  one  planned  for  ACCMS  are  not  reliable  and 
should  only  be  considered  as  rough  guides.  They  can  be  useful  as 
approximate  Indications  of  the  range  of  the  actual  value  of  the 
statistic,  or  for  detection  of  extremely  high  or  low  values  of 
the  estimate. 

Ut/hb 
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Attachment  9 


WESTAT,  INC. 

Memorandum 

TO:  Westat  Statistical  Staff  DATE:  December  15,  1977 

FROM:  Joe  Waksberg  SUBJECT: Increase  in  variance  with 

differential  sampling  rates 


We  frequently  propose  sample  designs  with  different  sampling 
rates  in  the  various  strata.  Where  there  is  no  reason  to  expect 
different  population  variances  among  strata,  such  a  design  will 
always  have  higher  sampling  variances  chan  a  sample  of  the  same  size 
with  a  uniform  sampling  race  in  all  strata. 

The  increase  in  the  variance  can  be  expressed  quite  simply  by 
some  algebraic  manipulation  of  standard  formulas.  If  P^,  P2.---.Pp 
denote  the  proportions  of  Che  total  populations  in  Che  various 

strata,  and  k-, . k^  are  the  ratios  of  the  sampling  races  in  the 

strata  to  the  sampling  rate  in  stratum  1  (i.e.,  -  r^/r^;  obviously 

kj_  -  1) ,  then  under  fairly  general  conditions  the  relative  increase 
in  variance  - is  equal  to : 

(Zk^)  (SPj/ki)  -  1 

The  expression  is  simple  and  a  handy  one  to  remember.  A 
derivation  of  this  formula,  and  another  way  of  expressing  the  same 
increase,  is  attached. 
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Let  the  population  be  divided  into  H  strata  with  mean  *2 _• 

x„  Assume  a  common  variance  a  in  all  strata.  The  populations  in 

the  various  strata  are  NL . NH,  with  the  proportion  of  the 

population  in  each  stratum 

PL . Ph  (i.e. .  Pt  -  t^/Zi^) 

x  -  ZPjX^ 

Compare  two  designs: 

(1)  a  uniform  sampling  rate  in  all  strata,  “  r.  The  total 
sample  size  is  n  -  rN  (N  -  ZNj_) ; 

(2)  differencial  sampling  rates,  the  rate  in  stratum  i  is  e^r. 
The  total  sample  size 

St^rNj^  -  n. 

That  is  the  total  sample  size  is  the  same  as  for  Plan  1. 

We  shall  restrict  our  analyses  to  situations  in  which  the 
populations  of  Che  strata  are  fairly  large  so  that  the 
finite  correction  factors  are  trivial.  The  variances  of 
these  two  sample  designs  are: 

2  2 

o  H  2  ?  H  a  a  ,, , 

<r2  -  Zdl./N)2*2  -  ZCNj/N)2  — - ~  (1> 

1  1  1  i  1  1  rNt  rN 

o  H  n  <7Z  a1  H  P< 

o2  -  2(Nj/N)2 - S  — i  (2) 

2  1  1  cirNi  rN  1  ci 


The  ratio  of  a 2  to  o2  is  therefore  ZP^/t^,  and  the  increase  ii 
variance  is  ZP^/t^  -  1. 

e 

This  can  be  expressed  more  simply  by  looking  at  the 
relationships  of  the  sampling  rates  among  strata  rather  chan  the 
rates  themselves.  Call  Che  stratum  with  the  lowest  sampling  race, 
stratum  1,  and  define 

ki  “  ci/cl- 

Obviously,  k^  -  1,  and  k^  >  1. 

Then  ZPL/tL  -  (1/^)  (ZP^)  O) 


‘  Hk 


Because  of  che  constraint  that  Zt^N^  -  n  -  rN,  it  can  be  seen 
St^P^  -  1.  Consequently, 

t^Zk^Pj.  -  1,  and 


1  *i*i 

Using  this  in  equation  (3),  we  have 


— r  -  ZVtt  -  (SP^)  (SkiPt> 


where  the  k^  reflect  the  variations  in  sampling  rates.  (Equation  (^) 
also  applies  with  an  arbitrary  choice  of  a  stratum  as  stratum  1. 
However,  in  that  case  the  effect  of  varying  the  rates  is  not  as 
easily  apparent.) 
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APPENDIX  3 

Household.  Touch.  and  Parental  Questionnaires 


ACCMS :  ROT  HOUSEHOLD  5CREEMER 


INTRODUCTION :  Hsllo,  this  is  (YOUR  NAME)  .  I  an  calling  Ires 

Westat .  a  ristarcA  fim  near  Washington,  D.C.  We  are  conduce 
an  important  national  sur/ey  Cor  the  Fadaral  Govamnent.  First. 
I'd  liXa  to  mates  sure  I've  dialed  correctly.  Is  this  ( AREA  CCOE 
AND  NUMBER) ? 

(INTERVIEWER:  ASK  TO  SPEAK  WITH  ADULT  HOUSEHOLD  MEMBER  IF  PERSON 
ANSWERING  TELEPHONE  SOUNDS  LIKE  A  YOUTH) 


.  YES  .  1  (SC-2) 

NO  . . .  2  (TERMINATE.  1  CODE  REDIAL, 

MAX  OF  2  CALLS) 

GO  TO  RESULT  .  3 


SC-2  We  are  calling  a  randoa  sanpla  of  telephone  minders  m  connect:.:.-. 

with  this  study,  and  we  need  to  )cnov  what  type  of  numner  this  -s. 

Is  this  phone  number  for 


hone  use .  1 

business  and  hone  use,  or.  2 

business  use  only?  .  3 

REFUSED  .  -7 

DON'T  KNOW  .  -« 


(SC-40) 

(SC-3) 

(TERMINATE.  2  CODE  NCN- 
RESIDENTXAL) 

(TERMINATE.  2  CODE  .INIT 
REFUSAL) 

(ASK  FOR  KNOWLEDGEABLE 
HOUSEHOLD  MEMBER,  RESTART  AT 
SC-2RI. 

IF  NONE  AVAILABLE, 

TERMINATE,  1  OR  5  CODE 
CALLBACK) 


SC- 3.  Is  this  phone  located  in  a  hone  or  in  a  business? 


HOKE  .  1  (SC-40) 

BOTH  . 2  (SC-40) 

BUSINESS  .  3  (TERMINATE.  2  CODE  NON- 


RESIOENTXAL) 

-7  (TERMINATE.  2  COOE  INIT  REFUSAL) 
-a  (ASK  FOR  KNOWLEDGEABLE 

HOUSEHOLD  MEMBER,  RESTART  AT 
SCKNOW. 

IF  NONE  AVAILABLE, 

TERMINATE,  i  CODE  CALLBACK) 


REFUSED  . . 
DON'T  KNOW 


-XUSEHOLD  SCREZNER 
3-0077 


(October  13, 


Are  you  a  somber  of  tills  household? 


REFUSED. 


DON'T  KNOW 
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(SC-5) 

(SCKNOW 

IF  NONE  AVAILABLE, 
TERMINATE,  *  CODE 
CALLBACK) 

(TERMINATE,  i  CODE 
REFUSAL) 

(SCKNOW 

IF  NONE  AVAILABLE, 
TERMINATE,  £  CODE 
CALLBACK) 


Since  the  survey  we  are  conducting  for  the  U.S.  governaen: 
concerned  with  the  career  plans  of  young  adults,  we  need  : 
how  many  young  adults  live  in  your  household. 

How  many  people  between  the  ages  of  13  and  24  live  m  you: 
household  including  chose  on  vacation,  away  on  business  c: 
away  at  school? 


NONE .  00  (SC-4B,  £  CODE 

INELIGIBLE  NO 
ONE  13-24) 

REFUSED  .  -7  (TERMINATE.  7  CODE 


DON'T  KNOW 


INIT  REFUSAL) 

(SCKNOW 

IF  NONE  AVAILABLE,  TSRMINA 
1  CODE  CALLBACK) 


CATI  CHECK  4 SCI:  IS  THERE  MORE  THAN  ONE  HOUSEHOLD 
MEMBER  13  THROUGH  24? 

[SC-5  >  l] 

YES  .  1  (SC-7) 


Is  this  person  sale  or  female? 


FEMALE 


REFUSED 


DON'T  KNOW 


1  (CODE  SC-7  AS  01;  CODE  SC- 
AS  00,  AND  THEN  GO  TO  SC-3 

2  (CODE  SC-7  AS  00;  CODE  SC- 
AS  01  AND  THEN  GO  TO  SC-3 
FOR  FEMALES) 

-7  (TERMINATE.  I  CODE 
INIT  REFUSAL) 

-8  (ASK  FOR  IQfOWLEDGEABLE 

HOUSEHOLD  MEMBER  RESTART  A 
SC-5 

IF  NONE  AVAILABLE,  TSRMINA 
£  CODE  CALLBACK) 
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OS  these  (NUMBER  FROM  SC-5) ,  how  aany  are  sale? 


NONE  .  00 

REFUSED  .  -7  (TERMINATE.  7  CODE 

IN IT  REFUSAL) 

DON'T  KNOW  .  -8  (ASK  FOR  KNOWLEDGEABLE 

HOUSEHOLD  MEMBER  RESTART  AT 
SC-5A 

IF  NONE  AVAILABLE,  TERMINAL 
£  CODE  CALLBACK) 


CAT!  CHECK  SC1A1:  IS  THE  NUMBER  OF  MALES  EQUAL  TO 
THE  TOTAL  13-24  (EAR  OLDS? 

(SC-7  -  SC-5] 


1  (CODE  SC7A-0 

CAT!  CHECX  43C1A; 

2  (SC-7A) _ 


A.  So,  oS  the  (NUMBER  FROM  SC-5)  13  to  24  year  olds,  your  housensi 
has  (SC-7)  sales,  and  ( (SC-5) - (SC-7) )  Semales? 

YES  .  1  (CATI  CHECK  $SC1A) 

NO  .  2  (SC7ACHK) 

REFUSED  .  -7  (TERMINATE.  7  CODE 

IN  IT  REFUSAL) 

DON'T  KNOW  .  -8  (SCXNOW 

IF  NONE  AVAILABLE,  TSRMINA 
£  CODE  CALLBACX) 


OAT I  CHECX  4SC1A:  ARE  THERE  ANY  13-24  YEAR  OLD  MALES 
IN  THE  HOUSEHOLD? 

( SC-7  >  0] 

YES  .  1  (CATI  CHECX  #SC1B) 

NO  .  2  (CATI  CHECK  »SC1B) 

tSClB:  ARE  THERE  ANY  13-24  YEAR  OLD  FEMALES 
IN  THE  HOUSEHOLD? 

(SC-7A  >  0] 

YES  .  1  (CATI  CHECK  *SC1D) 

NO  .  2  (CATI  CHECK  4SC1D) 

ISC1D:  IS  THE  HOUSEHOLD  IN  THE  FEMSAMP? 

YES  .  1  (ENUMERATE  RESPONDENT, 

MALES,  THEN  FEMALES) 
(CONF) 

NO  .  2  (ENUMERATE  RESPONDENT, 

THEN  MALES) 


[RESPONDENT  NAME  AND  AGE  ENUMERATED,  THEN  MALES,  THEN  FEMALES' 


*; 
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Your  answers  to  this  survey  are  voluntary  and  confidential, 
information  you  give  us  will  only  be  used  in  connection  with 
information  about  aany  other  young  adults.  Neither  your  nar.e 
any  other  identifying  information  will  appear  on  any  report  o 
this  study. 


while  you  aay  choose  not  to  answer  any  question,  this 
authorised  by  law,  and  the  information  you  give  is  is 
by  an  Act  of  Congress  called  the  Privacy  Act  of  1974. 


resear 

protec 


Are  you  between  13  and  24  years  old? 


YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


(SC-8A) 

(CATI  CHECK  #SC 3) 

{TERMINATE  a  CODE  INIT  REFU5A 
( SCKNOW 

IF  NONE  AVAILABLE,  TERM 
i  CODE  CALLBACK) 


Please  give  ae  your  first  name. 


REFUSED  . . 
DON'T  KNOW 


(SC-8) 

(TERMINATE.  1  CODE 
INIT  REFUSAL) ) 
(SCKNOW 

IF  NONE  AVAILABLE, 
1  CODE  CALLBACK) 


lERMIMA 


(Starting  with  the  oldest)  Please  give  ae  the  first  name  of 
(each/the/the  oldest)  (aale/ female)  in  your  household  between  1 
and  24.  (RECORD  ALL  NAMES  IN  GRID  BELOW.) 

1.  _ 

2.  _ 

3.  _ 

4.  _ 

5.  _ 


REFUSED  .  -7  (TERMINATE,  a  CODE 

INIT  REFUSAL) 

DON’T  KNOW  .  -8  (ASK  FOR  KNOWLEDGEABLE 

HOUSEHOLD  MEMBER  RESTART  A 
SC-5RI 

IF  NONE  AVAILABLE,  TERMINA 
2  CODE  CALLBACK) 


HOUSEHOLD  SC7ESNER 
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3ATI  CHECX  »SC2:  ASK  SC-9  FOR  RESPONDENT,  1ST  MALE/FEMALE; 
_ LISTED  IN  SC-9 _ _ _ 


SC-9 .  what  is  ( PERSON ' S/your)  data  of  birth? 


DO  'i'i 


(CATI  CHECK  4SC3 ) 


REFUSED  .  -7  (SC-10) 

DON'T  KNOW  .  -8  (SC-10) 


SC- 10.  How  old  is  (PERSON/ara  you)? 

_  (CATI  CHECK  *SC3 ) 

REFUSED  .  -7  (SC-10A) 

DON'T  KNOW  .  -8  (SC-10A; 

5C-10A.  (Is  PERSON/Ara  you)  13  to  IS  yaars  old,  16  to  20  years  old,  :i 
to  24  yaars  old,  or  sqm  othar  aga? 

13  to  13  .  1  (CATI  CHECK  *SC2A) 

Ifi  CO  20  .  2  (CATI  CHECK  4SC2A) 

21  to  24  .  3  (CATI  CHECK  4SC2A) 

SOME  OTHER  ACE  .  4  (CATI  CHECK  4SC2A) 

REFUSED  .  -7  (TERMINATE.  1  CODE 

INIT  REFUSAL) 

DON'T  KNOW  .  -8  (ASK  FOR  KNOWLEDGEABLE 

HOUSEHOLD  MEMBER  RESTART  AC 
SC-5RI 

IF  NONE  AVAILABLE,  TERM  I)!  AC 
1  CODE  CALLBACK) 


CATI  CHECK  4SC2A: 


IS  CURRENT  ENUMERATION  FOR  THE 
RESPONDENT? 

YES  .  I  (SC-10B) 

-NO  . . 2  f CATI  CHECK  *SC3) 


SC- LOB.  [IF  NOT  OBVIOUS,  ASK]  what  is  your  sax? 

MALE  .  1  (SC-10C) 

FEMALE  .  2  (SC-10C) 

REFUSED  .  -7  (TERMINATE.  1  CODE 

INIT  REFUSAL) 

DON'T  KNOW  .  -8  (ASK  FOR  KNOWLEDGEABLE 

HOUSEHOLD  MEMBER  RESTART  AT 
SC-5RI 

IF  NONE  AVAILABLE,  TERMINATE 
i  CODE  CALLBACK) 


k£l 


ULE:  HOUSEHOLD  SCREENER 

x  02-0077 


(October  13,  1986)  pg  0-  7 

•xpiration  31  August. 


SC-11A.  ;  Is  ?ERSON/Are  you)  presently  serving  in  the  military'’ 

YE S  .  1  ( CATI  CHECK  *SC3) 

HO  .  2  (SC-12) 

REFUSED  .  -7  (SC-12) 

DON'T  KNOW  .  -8  (SC-12) 

SC- 12 .  (Has  he/Has  she/Have  you)  baan  accepted  for  service  in  a  orar 
of  the  Armed  Forcas  and  (is/ara)  now  waiting  to  go  on  active 
duty? 

YES  .  1  (CATI  CHECK  #SC3) 

NO  .  2  (SC-13A) 

REFUSED  .  -7  (SC-13A) 

DON'T  KNOW  .  -8  (SC-13A) 

SC- 13 A .  Do  you  hava  a  regular  high  school  diploma,  a  GED,  an  ABE,  c: 
soma  othar  Kind  of  cartificata  of  high  school  completion? 


REGULAR  HIGH  SCHOOL  DIPLOMA  .  1  (SC-14) 

GED  (GENERAL  EDUCATIONAL  DEVELOPMENT)  2  (SC- 14) 

ABE  (ADULT  BASIC  EDUCATION) 

CERTIFICATE  (E.G.  CORRESPONDENCE, 

NIGHT  SCHOOL)  .  3  (SC-14) 

SOME  OTHER  KIND  OF  CERTIFICATE  .  4  (SC-14) 

NONE  OF  THE  ABOVE  .  5  (SC-14) 

REFUSED  .  -7  (SC-14) 

DON'T  KNOW  .  -8  (SC-14) 


(SC-14) 

(SC-14) 

(SC-14) 


SC- 14.  (Is  PERSON/ara  you)  currently  enrolled  in  school? 

YES  .  1  (SC-15) 


NO  . 

REFUSED 


2  (SC-13) 
-7  (SC-13) 


DON'T  KNOW  .  -8  (SC-13) 


■VW'.  v.-v--.-.  ■r. 
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In  what  type  a f  school  or  training  prograa  (Is  he/ Is  she/ Are 
:urrentlv  enrolled? 


TAKING  DAY  COURSES  IN  REGULAR , 

DAY  HIGH  SCHOOL  . 

ADULT  3 ASIC  EDUCATION  (ABE)  HS 
COURSES  IN  NIGHT  SCHOOL  OR  3Y 

CORRESPONDENCE)  . 

GED  OR  HIGH  SCHOOL  EQUIVALENCY 

PROGRAM  . 

SKILL  DEVELOPMENT  PROGRAM  (EG 
PUBLIC  EMPLOYMENT,  JOBS,  OIC 

WIN ,  CETA)  . 

ON-THE-JOB  TRAINING  PROGRAM  . . . 

APPRENTICESHIP  PROGRAM  . 

VOCATIONAL,  BUSINESS  OR  ADE 

SCHOOL  . 

A  2  YEAR  JUNIOR  OR  COMMUNITY 

COLLEGE  . 

A  4  (5)  YEAR  COLLEGE  OR 

UNIVERSITY . 

SOME  OTHER  SCHOOL  . 

REFUSED  . 

DON’T  KNOW  . 


01  (SC-16) 


02  (SC-13) 
03  (SC-13) 


04  (SC-13) 
05  (SC-13) 
06  (SC-13) 

07  (SC-13) 

08  (SC-13) 

09  (SC-17) 
10  (SC-13) 
-7  (SC-13) 
-3  (SC-13) 


(Is  he/ Is  she/Are  you) 
12th  grade? 


snrqUcd  in  9th,  loth, 


9TH  9  (SC-13B) 

10TH  .  10  (SC-13B) 

U.TH  .  11  (SC-13B) 

12TH  .  12  ( SC-13  B) 

REFUSED  .  -7  (SC-13) 

DON’T  KNOW  .  -8  (SC-13) 


(Is  he/Is  she/Are  you)  currently  enrolled  in  (his/her,,  your ■ 
first,  second,  third,  fourth  or  fifth  year  of  college?" 

FIRST  YEAR  (FRESHMAN) .  1  (SC-13B) 

SECOND  YEAR  (SOPHOMORE) .  2  (SC-13B) 

THIRD  YEAR  (JUNIOR) .  3  (SC-13B) 

FOURTH  YEAR  (SENIOR) .  4  (SC-13B) 

FIFTH  YEAR  (OF  A  5  YEAR  COLLEGE)  5  (SC-13B) 

REFUSED  .  -7  (SC-13) 

DON’T  KNOW  .  -8  (SC-13) 

So,  the  highest  level  (college/high  school)  that  (you  have, he 
has/she  has)  completed  and  received  credit  for  is  (the)  (college 
year/high  school  grade)? 

YES  .  1  (SC-18) 

NO  .  2  (SC-13) 

REFUSED  . -7  (SC-13) 

DON ’ T  KNOW  . -8  (SC-13) 


•W 


v,,#rjr)rv/rKiKU'’w  v  w; 
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What  is  the  highest  grads  or  level  of  schooling  that  {he  r.as,  sr.e 
has/vou  have)  completed  and  received  credit  for? 


LESS  THAN  3TH  GRADE  .  07 

3TH  GRADE  .  08 

9TH  GRADE  .  09 

10TH  GRADE  .  10 

11TH  GRADE  .  11 

12TH  GRADE  .  12 

1ST  'TEAR  OF  4  YEAR  COLLEGE  (FR) .  13 

2ND  YEAR  OF  4  YEAR  COLLEGE  (SO)  .  14 

3RD  YEAR  OF  4  YEAR  COLLEGE  (JR)  .  15 

4TH  YEAR  OF  4  YEAR  COLLEGE  (SR)  .  16 

5TH  YEAR  COLLEGE,  1ST  YEAR  GRADUATE 

OR  PROFESSIONAL  SCHOOL .  17 

2ND  YEAR  GRADUATE  OR  PROFESSIONAL 

SCHOOL  .  13 

3RD  YEAR  GRADUATE  OR  PROFESSIONAL 

SCHOOL  .  19 

MORE  THAN  3  YEARS  GRADUATE  OR 

PROFESSIONAL  SCHOOL  .  20 

1ST  YEAR  OF  JR  OR  COMMUNITY  COLLEGE  .  21 
2ND  YEAR  OF  JR  OR  COMMUNITY  COLLEGE.  22 
1ST  YEAR  OF  VOCATIONAL  BUSINESS  OR 

TRADE  SCHOOL .  23 

2ND  YEAR  OF  VOCATIONAL  BUSINESS  OR 

TRADE  SCHOOL  .  24 

MORE  THAN  2  YEARS  OF  VOCATIONAL 

BUSINESS  OR  TRADE  SCHOOL .  23 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


(SC-18) 

(SC-13) 

(SC-13) 

(SC-13) 

(SC-13) 

(SC-13) 

(SC-18) 

(SC-18) 

(SC-13) 

( CATI  CHECK 

( CATI  CHECK 

(CATI  CHECK 

(CATI  CHECK 

(CATI  CHECK 

(SC-13) 

(SC-18) 

(SC-18) 

(SC-18) 

(SC-13) 

(SC-13) 

(SC-13) 


:s  he/Is  she/Are  you)  living  at  this  address? 


YES  .  1  (SC- 19) 

NO  .  2  (CATI  CHECK  4SC-'3) 

REFUSED  .  -7  (CATI  CHECK  *SC-*3) 

DON’T  KNOW  .  -8  (CATI  CHECK  4SC-‘3) 


CATI  CHECK  »SC7B:  IS  RESPONDENT  CURRENTLY  ENROLLED  IN 
IN  COLLEGE? 

(SC-14-1)  AND  (SC-13-8,9) 

YES  . . 1  (SC-18A) 


SC-13A  (Is  he/Is  she/Are  you)  living  in  undergraduate  student  housing? 

'PROBE:  That  is,  undergraduate  housing  that  is  owned,  leased  o: 
oonsored  by  the  school  (he  is/she  is/you  are)  attending? 

YES  .  1  (SC-19) 

NO  .  2  (CATI  CHECK  »SC3) 

REFUSED  .  -7  (SC-19) 

DON’T  KNOW  .  -8  (SC-19) 


'■•v.V.V  v' 


(October  13,  1986)  pg  o- 

expiration  31  August 


HOUSEHOLD  SCREENER 


CATI  CHECK  *SC3:  FLAG  AS  INELIGIBLE  FOR  MAIN 
_ INTERVIEW  AND  CO  TO  CATI  CHECX  «SC9 


Please  tell'  as  whether  (PERSON  is/you  are)  : 


White  .  1 

BlacJt  .  2 

Asian  or  Pacific  Islander,  or  . . ■  3 

American  Indian  or  Alaskan  Native  4 

REFUSED  .  -7 

DON’T  KNOW  .  -3 


(Is  he/I s  she/Are  you)  Hispanic? 


YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


What  is  (your/ PERSON'S)  last  name? 


REFUSED  .  -7 

DON’T  KNOW  .  -8 


(ATI  CHECK  4SC9:  MORE  16-24  YEAR  OLD  MALES/FEMALES  TO 
ENUMERATE? 


YES  .  1  (CATI  CHECK  4SC7A  FOR 

NEXT  MALE/ FEMALE) 

NO  .  2  (CATI  CHECK  4SC24) 


♦  SC2  4 :  IS  ANYONE  IN  THIS  HOUSEHOLD  ELIGIBLE? 

YES  .  1  (SC-21) 

NO  .  2  (CATI  CHECX  4SC25) 

»SC23:  ARE  THERE  ANY  13-15  YEAR  OLDS  IN  THIS  | 
HOUSEHOLD  ! 

I 

YES  .  1  (SC-4B)  I 

_ HO  .  2  (TERMINATE .  ) _ I 


HOUSEHOLD  SCREEN ER  (October  13,  1986)  pg  3-  - : 

3-000'  axpiration  31  August,  15 

what  court,  lo  you  liva  in? 

_  (SC-4C) 

REFUSED .  -7  (TERMINATE.  2  CODE  IN  IT 

REFUSAL) 

DON'T  KNOW  .  -8  (ASK  FOR  KNOWLEDGEABLE 

HOUSEHOLD  MEMBER,  RE3TA? 
SC-2. 

IF  NONE  AVAILABLE, 
TERMINATE,  £  CODE  CALL3A 


What  is  your  zip  coda? 


REFUSED. 


DON'T  KNOW 


(SC-35) 

-7  (TERMINATE.  £  CODE  IMIT 
REFUSAL) 

-8  (ASK  FOR  KNOWLEDGEABLE 

HOUSEHOLD  MEMBER,  RE3TAP. 
SC-2. 

IF  NONE  AVAILABLE, 
TERMINATE,  5  CODE  CALL3A 


OATI  CHECX  ♦SC25AJL:  IS  COUNTY  OR  ZIP  MISSING? 

SC-48  OR  SC-4C  -  -7  OR  -8 

YES  .  1  (SC-4E) 


RM 


3C-4E.  what  city  do  you  liva  in? 


REFUSED  . . . 
DON'T  KNOW 


(SC-35) 
-7  (SC-35) 
-8  (SC-35) 


3C-35.  Ara  thara  any  talaphona  nuabars  in  addition  to  (SAMPLE  TELEPHONE 
NUMBER)  in  your  homa? 

•  YES  .  1  (SC-36) 

NO  .  2  (CAT!  CHECK  *SC25A) 

REFUSED  .  7  ( CAT!  CHECX  4SC25A) 

DON'T  1QK3W  .  3  ( CAT!  CHECK  4SC25A) 


SC- 3 6  la  this  nuabar  for 


hoaa  usa .  1  (CATI  CHECK  ISC25A) 

businass  and  hoaa  usa,  or.  2  (SC-36A) 

businass  usa  only?  .  3  (CATI  CHECK  4SC25A) 

REFUSED  .  -7  (CATI  CHECK  4SC25A) 

OON'T  KNOW .  -8  (CATI  CHECK  ISC25A) 


'W.v'.vV.nW.’a' 
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.A.  is  this  phone  located  in  a  home  or  in  a  business? 


HOME  .  1  (CATI  CHECK  *SC2 5A) 

30TH  .  2  (CATI  CHECK  ISC25A) 

BUSINESS  .  3  (CATI  CHECK  *SC25A) 

REFUSED  .  -7  (CATI  CHECK  *SC25A) 

DON'T  KNOW  .  -8  (CATI  CHECK  ♦SC25A) 


CATI  CHECK  4SC2SA:  ARE  THERE  ANY  13  TO  15  YEAR  OLD 
HOUSEHOLD  MEMBERS? 


YES  .  1  (INTR013) 

NO -  ..  2.  .(CATI.  CHECK  *SC26) 


CATI  CHECX  «SC2 6 :  ARE  THERE  ANY  ELIGIBLE  PERSONS? 

YES  .  1  (HH CHOOSE) 

_ NO  .... -  2.  f TERMINATE  3) 


B-12 
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(■SEMINATION  SCREENS 


(ERMl  Thank  you  very  auch,  but  I  seem  to  have  dialed  a  wrong  nuacer. 

It  is  possible  that  your  number  will  be  dialed  again  at  a  later 
time. 

REDIAL  .  1  (RESTART  AT  INTRO) 

NON-WORKING  NUMBER  [IF 
NUMBER  HAS  BEEN  DIALED 
TWICE]  .  2 


‘ERM2  Thank  you  very  auch,  that's  all  the  question  that  I  have  at  this 
time . 


'El-H 3  Thank  you  very  auch,  that's  all  the  questions  I  have  at  this 
tiae. 

CODE  NON- RESIDENTIAL 


isms  ENTER  THE  RESULT  COOE  USING  THE  DEFINITIONS  BELOW: 


CALLBACK  -  NO  APPOINTMENT .  4 

CALLBACK  -  APPOINTMENT  .  5  f  APPT) 


:ER-M6  At  this  time,  we  are  only  interested  in  interviewing  in 

households  with  13  to  24  year  olds  so  I  have  no  further  questisr 
for  you  at  this  time.  The  information  you  have  given  us  is 
confidential  and  is  protected  under  the  Privacy  Act  of  1934. 

This  survey  is  for  research  purposes  only,  and  is  authorized  sy 
law  in  Title  10  (JSC  Sections  503  and  2359.  Thank  you  very  aucr. 
for  your  time.  Good  bye. 

CODE  NO  ELIGIBLE  HOUSEHOLD  MEMBERS 


3ERM7  The  information  you  have  given  us  is  confidential.  This  survey 
is  for  rssearch  on  how  young  people  sake  career  decisions  and  is 
authorizsd  by  law  in  Title  10  USC  Sections  503  and  2358.  Thank 
you  for  your  tins.  Good  bys. 


3ERM8  I  have  no  further  questions  for  you  at  this  time.  The 

information  you  have  given  us  is  confidantial  and  is  protected  = 
an  Act  of  Congress  called  the  Privacy  Act  of  1974.  This  survey 
is  for  rssearch  purposes  only  and  is  authorizsd  by  law  in  Title 
10  USC  Sections  503  and  2358.  Thank  you  vary  ouch  for  your 
cooperation.  Good  bye. 


D—  L  it 
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3ERM9  Let  me  remind  you  that  the  information  you  have  given  us  is 

confidential  and  is  protected  by  an  Act  of  Congress  called  the 
Privacy  Act  of  1974.  This  survey  is  for  research  purposes  onl. 
and  is  authorized  by  law  in  Title  10  Sections  SQ3  and  2  3  53  ar.d 
Executive  order  9397. 

I  have  no  further  questions  to  as)c  you  at  this  time,  but  would 
you  please  stay  on  the  line  for  one  moment  so  thit  I  can  cr.ec.< 
see  if  I  need  to  speak  with  anyone  else  in  your  household. 

Thank  you  very  much  for  your  cooperation.  Good  bye. 


RESTART  SCREENS 


SC-2RI .  Hsllo,  this  is  (YOUR  NAME).  X  am  calling  from  westat,  a 
research  firm  near  Washington,  Q.C.  We  are  conducting  an 
important  national  survey  for  the  Federal  Government. 


3 C - KNOW .  Hallo,  this  is  (YOUR  NAME).  I  am  calling  from  Westat,  a 
research  firm  near  Washington,  D.C.  We  are  conducting  an 
important  national  survey  for  the  Federal  Government.  The  sir- 
is  concerned  with  the  career  plane  of  young  adults.  Your  ar.sue 
are  voluntary  and  will  be  completely  confidential.  Your  identi 
will  never  be  Known  by  anyone  except  the  research  project  staff 

I  would  like  to  begin  by  asking  some  questions  about  household 
members . 


;-L5  YEAR  OLD  TRACXING  INFORMATION 


CATI  CHECX  tSC23 :  WERE  ANY  13  TO  15  YR  OLDS  ENUMERATED? 

[SC-9,  10,  23  OR  24  >12  AND  <16] 

YES  .  1  ( INTR013 ) 


INTRO 13 


It  is  possible  that  we  will  call  again  sometime  in  the  future 
obtain  some  updated  information  from  you. 


'COULE:  HOUSEHOLD  SCREENED  (October  13,  1936)  pq  0-  1 

:H3  :  3- 32*0077  expiration  31  August, 

SC-13.  Please  give  me  the  name,  address  and  telephone  number  of  a 
or  family  member  not  at  this  address  who  would  *now  how  to 
touch  with  you  in  case  we  need  to  contact  you  again  and  na 
hard  time  getting  hold  of  you. 

.HAKE:  _ 

STREET:  _ _ _ - 

CITY:  _ 

STATE:  _ 

ZIP:  _ 

‘  PHONE :  _ 

30  TO  OATI  CHECK  *SC26] 


tt-15 


a 
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INTRODUCTION:  I  have  soae  questions  about  your  educational  ar.d 

employment  experiences. 

Do  you  have  a  regular  high  school  diploma,  a  GED,  an  ABE,  or  so: 
other  Icind  of  certificate  of  high  school  completion? 

REGULAR  HIGH  SCHOOL  DIPLOMA  .  1 

GED  (GENERAL  EDUCATIONAL 

DEVELOPMENT)  .  2 

ABE  (ADULT  BASIC  EDUCATION) 

CERTIFICATE  (E.G.,  CORRESPONDENCE, 

NIGHT  SCHOOL)  .  3 

SOME  OTHER  KINO  OF  CERTIFICATE .  4 

NONE  OF  THE  ABOVE  .  S 

REFUSED  .  -7 

DON'T  KNOW  .  -3 

Are  you  currently  enrolled  in  school,  college,  a  vocational  or 
technical  program,  apprenticeship  or  a  job  training  program? 

YES  .  1  (EE-6) 

NO  .  2  (EE-5) 

REFUSED  .  -7  (EE-5) 

DON'T  KNOW  .  -8  (EE-5) 

In  what  month  and  year  did  you  last  attend  any  type  of  school  :: 
training  program? 


■6.  what  Kind  of  school  or  training  program  (are  you/were  you  las: 
enrolled  in: 

TAXING  H.S.  COURSES  IN  REGULAR 

DAY  HIGH  SCHOOL .  1 

GED  OR  HIGH  SCHOOL  EQUIVALENCY 

PROGRAM  .  2 

ADULT  BASIC  EDUCATION  (ABE) 

(H.S.  COURSES  IN  NIGHT  SCHOOL 

OR  BY  CORRESPONDENCE)  .  3 

SKILL  DEVELOPMENT  PROGRAM 
(E.G. ,  PUBLIC  EMPLOYMENT, 

JOBS,  OIC,  WIN,  CETA)  .  4 

ON  THE  JOB  TRAINING  PROGRAM  .  5 

APPRENTICESHIP  PROGRAM  .  6 

VOCATIONAL,  BUSINESS  OR 

TRADE  SCHOOL  .  7 

2  YEAR  JR  OR  COMMUNITY  COLLEGE  .  8 

4  YEAR  COLLEGE  OR  UNIVERSITY  .  9 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


I 


was 


TATI  CHECK  iEEl:  IS  RESPONDENT  CURRENTLY  ENROLLED? 
(EE-4-1) 

YES  .  1  (CATI  CHECK  4EE-1A) 

NO  .  2  (EE-1) 

TATI  CHECX  *E£1A  IS  RESPONDENT  IN  HS  CR  4  YR  COLLEGE? 
(EE-6-1)  OR  (EE-4-9) 

HS  . 1  (EE-4A) 

COLLEGE  ..  .2  (EE-68) 


IE-3A.  (Is  he/Is  sha/Are  you) 
12CH  grada? 


anrollad  in  9th,  10th, 


9TH  9  (EE- IVES) 

10TH  .  10  (EE- ITER) 

11TH  .  11  (EE-1VER) 

12TH  .  12  (EE- IVES) 

REFUSED  .  -7  (EE-1) 

DON'T  KNOW  .  -8  (EE-1) 


•■5a.  'Is  ha/Is  sha/Ara  you)  currently  anrollad  in  (his/her/your ) 
:rst.  sacond,  third,  fourth  or  fifth  yaar  of  collega? 


FIRST  YEAR  (FRESHMAN) .  1  (EE-1VER) 

SECOND  YEAR  (SOPHOMORE) .  2  (EE-1VER) 

THIRD  YEAR  (JUNIOR) .  3  (EE-1VER) 

FOURTH  YEAR  (SENIOR) .  4  (EE-1VER) 

FIFTH  YEAR  (OF  A  5  YEAR  COLLEGE)  5  (EE-1VER) 

REFUSED  . -7  (EE-1) 


DON'T  KNOW 


-a  (EE-1) 


.VSR .  So,  tha  highast  Iavai  (collaga/high  school)  that  (you  have 
has/sha  has)  completed  and  received  credit  for  is  (the)  (col 
year/high  school  grade)? 

YES  . .  1  (EE-3) 

NO  .  2  (EE-1) 

REFUSED  . -7  (EE-1) 

DON'T  KNOW  . -8  (EE-1) 
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(Yhat  is  the  highest  grade  or  year  of  school  or  college  that 
have  completed  and  received  credit  for? 

LESS  THAN  8TH  GRADE  .  07  (EE- 3) 

3TH  GRADE  .  08  (EE- 3) 

9TH  GRADE  .  09  (EE- 3) 

10TH  GRADE  .  10  (EE- 3) 

11TH  GRADE  .  11  (EE-31 

12TH  GRADE  .  12  (EE-3) 

1ST  TEAR  OF  4  YEAR  COLLEGE  (FR) .  13  (EE-3) 

2ND  YEAR  OF  4  YEAR  COLLEGE  (SO)  .  14  (EE-3) 

3RD  YEAR  OF  4  YEAR  COLLEGE  (JR)  .  15  (EE-3) 

4TH  YEAR  OF  4  YEAR  COLLEGE  (SR)  .  16  (EE-3) 

5TH  YEAR  COLLEGE,  1ST  YEAR  GRADUATE 

OR  PROFESSIONAL  SCHOOL .  17  (EE- 3) 

2ND  YEAR  GRADUATE  OR  PROFESSIONAL 

SCHOOL  .  18  (EE-3) 

3RD  YEAR  GRADUATE  OR  PROFESSIONAL 

SCHOOL  .  19  (EE- 3) 

MORE  THAN  3  YEARS  GRADUATE  OR 

PROFESSIONAL  SCHOOL  .  20  (EE-3) 

1ST  YEAR  OF  JR  OR  COMMUNITY  COLLEGE  .  21  (EE-3) 

2ND  YEAR  OF  JR  OR  COMMUNITY  COLLEGE.  22  (EE-3) 

1ST  YEAR  OF  VOCATIONAL  BUSINESS  OR 

TRADE  SCHOOL  .  23  (EE-3) 

2ND  YEAR  OF  VOCATIONAL  BUSINESS  OR 

TRADE  SCHOOL  .  24  (EE-3) 

MORE  THAN  2  YEARS  OF  VOCATIONAL 

BUSZNESS  OR  TRADE  SCHOOL  .  25  (EE- 3) 

REFUSED  .  -7  (EE- 3) 

DON'T  KNOW  .  -B  (EE-3) 
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what  is  the  highest  grade  or  year  of  school  or  college  you  p.a: 
to  eventually  complete’ 


LESS  THAN  3TH  GR-.CE  .  07 

3TH  GRADE  .  03 

9TH  GRADE  .  09 

10TH  GRADE  .  10 

11TH  GRADE  .  11 

12TH  GRADE  .  12 

1ST  YEAR  OF  4  YEAR  COLLEGE  (FR> .  13 

2ND  YEAR  OF  4  YEAR  COLLEGE  (SO)  .  14 

3RD  YEAR  OF  4  YEAR  COLLEGE  (JR)  .  15 

4TH  YEAR  OF  4  YEAR  COLLEGE  (SR)  .  16 

5TH  YEAR  COLLEGE,  1ST  YEAR  GRADUATE 

OR  PROFESSIONAL  SCHOOL  .  17 

2ND  YEAR  GRADUATE  OR  PROFESSIONAL 

SCHOOL  .  13 

3RD  YEAR  GRADUATE  OR  PROFESSIONAL 

SCHOOL  .  19 

MORE  THAN  3  YEARS  GRADUATE  OR 

PROFESSIONAL  SCHOOL  .  20 

1ST  YEAR  OF  JR  OR  COMMUNITY  COLLEGE  .  21 
2ND  YEAR  OF  JR  OR  COMMUNITY  COLLEGE.  22 
1ST  YEAR  OF  VOCATIONAL  BUSINESS  OR 

TRADE  SCHOOL  .  23 

2ND  YEAR  OF  VOCATIONAL  BUSINESS  OR 

TRADE  SCHOOL . 24 

MORE  THAN  2  YEARS  OF  VOCATIONAL 

BUSINESS  OR  TRADE  SCHOOL .  23 

RETUSED  .  -7 

DON'T  KNOW  .  -8 


CAT I  CHECK  4EE2A:  IS  EEI  >  3? 


YES  .  1  (EE-7) 

NO  .  2  f  EE-16 ' 


(EE-7) 

(EE-7) 

(EE-7) 

(EE-7) 

(EE-7) 

(EE-7) 

(EE-7) 

(EE-7) 

(EE-7) 

(EE-7) 


(EE-7) 


(EE-7) 


(EE-7) 


(EE-7) 

(EE-7) 

(EE-7) 


(EE-7) 


(EE-7) 


(EE-7) 

(EE-7) 

(EE-7) 


& 


v.v.v.v 
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'Did/ Doss)  your  school  use  latter  or  number  grades? 


LETTER  .  1 

NUMBER  .  2 

NEITHER  .  3 

REFUSED  .  -7 

DON'T  KNOW  .  -3 


[IF  LETTER  ASK  LETTER,  IF  NUMBER  ASK  NUMBER; 

what  grades  (do/did)  you  usually  get  in  school?  (Ara/Were)  ~r. 
[PROBE:  This  includes  grades  9  through  12] 


mostly  A 1 S  (AVERAGE  OF  90-100)  1 

Mostly  A'S  &  B's  (AVERAGE  OF  85-89)  2 

Mostly  B'S.  (AVERAGE  OF  30-84)  3 

Mostly  B'S  8  C's  (AVERAGE  OF  75-79)  4 

Mostly  C's  (AVERAGE  OF  70-74)  5 

Mostly  C'S  i  D'S  (AVERAGE  OF  65-69)  5 

Mostly  D'S  &  F'S  (AVERAGE  OF  64  AND  BELOW) .  7 

REFUSED  .  -7 

DON'T  KNOW  .  -3 


12.  Now  I  have  a  list  o £  high  school  mathematics  and  technical 
courses.  As  I  read  each  one,  please  tell  me  whether  you  .nave 
taican  or  plan  to  taJce  that  course  in  regular  high  school. 
Elementary  algebra? 


TAKEN  .  1 

PLAN  TO  TAKE  .  2 

NOT  TAKEN  AND  NOT  PLANNING  TO .  3 

REFUSED  .  -7 

DON'T  KNOW  .  -8 

12.  Plane  geometry? 

TAKEN  .  1 

PLAN  TO  TAKE  .  2 

NOT  TAKEN  AND  NOT  PLANNING  TO .  3 

REFUSED  .  -7 

DON'T  KNOW  .  -8 

12.  Intermediate  algebra? 

TAKEN  .  1 

PLAN  TO  TAKE  .  2 

NOT  TAKEN  AND  NOT  PLANNING  TO .  3 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


:ATI  CHECK  »EE3:  DID/DOES  YOUTH  WORK  FULi  TIME? 
[EE-19  >  34  ] 


1  (EE-24) 


w  w 

111  (ij 


r 
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How  aasy  or  difficult  is  it  lor  someone  your  aga  to  get  a  fui. 
time  30b  in  your  community?  Is  it.... 


almost  impossible  .  1 

vary  difficult  .  2 

somewhat  difficult,  or  .  3 

not  difficult  at  all?  .  4 

RE  FUSED .  -? 

DON’T  KNOW .  -8 


[GO  TO  INTENTIONS  >  PROPENSITY  MODULE] 


S:  YOUTH  QUESTIONNAIRE  (October  13,  1986)  INTENTIONS  i  PROPENSIT 
"02-0077  expiration  31  August,  1989  pg.  2-1 

Now  let's  talk  about  your  plans  f or  the  next  few  years.  it. a 
you  think  you  sight  be  doing?  {PROBE:  Anything  else?)  ' re 
ALL  THAT  APPLY] 


GOING  TO  SCHOOL  .  1  (IP-7) 

WORKING  .  2  (IP-7) 

DOING  NOTHING  .  3  (IP-7) 

JOINING  THE  MILITARY/ SERVICE  .  4  (IP-3) 

OTHER  .  5  (IP-7) 

REFUSED  .  -7  (IP-7) 

DON'T  KNOW  .  -8  (IP-7) 


You  said  you  sight  be  joining  the  military.  which  brancn  of 
service  would  that  be? 


AIR  FORCE  . . . 

ARMY  . 

COAST  GUARD  . 
MARINE  CORPS 

NAVY  . 

REFUSED  . 


DON’T  KNOW  .  -8 


(IP-4) 

(IP-4) 

(IP-4) 

(IP-4) 

(IP-4) 

(IP-?) 

(IP-7) 


which  type  of  service  would  that  be?  Would  it  be: 

Active  Duty  .  1 

The  Reserve,  or  .  2 

The  National  Guard  .  3 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


If  you  found  for  some  reason  you  couldn't  join  the  (SERVICE 
IP-3 )  which  branch  of  the  service  would  be  your  next  choice? 


AIR  FORCE  . . . 

ARMY  . 

COAST  GUARD  . 
MARINE  CORPS 


NAVY  . 

NONE  . 

REFUSED  . 


DON'T  KNOW  .  -8 


(IP-6) 

(IP-6) 

(IP-6) 

(IP-6) 


(IP-6) 

(IP-7) 

(IP-7) 

(IP-7) 


IP-6 .  Which  type  of  service  would  that  be?  Would  it  be: 

Active  Duty  .  1 

The  Reserve,  or  .  2 

The  National  Guard  .  3 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


W  JV  JV  .V  .V  m>  „V  .N  JW  mV  .v  .Vm%  mV  ,V  ‘.'.N  .V  V  _*N  .V  _V  A  „V  A  ■, 
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?- ’ .  How  likely  is  it  that  you  will  be  serving  in  the  military?  w c 
you  say. . . 

definitely  .  1 

probably  .  2 

probably  not,  or  .  3 

definitely  not?  .  4 

REFUSED  .  -7 

DON’T  KNOW  .  -8 

P-14.  How  likely  is  it  that  you  will  be  going  to  college?  would  you 
say. . . 

definitely  .  1  (IP-15) 

probably  .  2  (IP-15) 

probably  not,  or  .  3  (IP-16) 

definitely  not?  .  4  (IP-16) 

REFUSED  .  -7  (IP-16) 

DON’T  KNOW  .  -8  (IP-16) 

P-15'.  Oo  you  think  that  you  will  go  to  a  2-year  or  a  4-year  college7 

2  YEAR  COLLEGE  .  1 

4  YEAR  COLLEGE  .  2 

REFUSED  .  -7 

DON’T  KNOW  .  -8 

P-ll.  How  likely  is  it  that  you  will  participate  in  at  least  one 

college  course  offered  by  the  Aray  Reserve  Officer’s  Training 
Corps,  or  Aray  R.O.T.C?  Would  you  say... 

definitely  .  1 

probably  .  2 

probably  not,  or  .  3 

definitely  not?  .  4 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


P-15.  How  likely  is  it  that  you  will  be  going  to  vocational  or 
technical  school?  Would  you  say... 


definitely  .  1 

probably  .  2 

probably  not,  or  .  3 

definitely  not?  .  4 

REFUSED  . -7 

DON'T  KNOW  .  -8 


NCTH  QUESTIONNAIRE  (October  13,  1996) 
::-oo~7  expiration  31  August,  1939 


INTENTIONS  i  PROPENSITY 
pg.  2-3 


How  likely  is  it  that  you  will  be  working  in  a  civilian  ;cc? 
Would  you  say... 


definitely  .  1  (IP-13) 

probably  .  2  (IP-13) 

probably  not,  or  .  3  (CaTI  CHECK 

definitely  not?  .  4  (CATI  CHECK 

REFUSED  .  -7  (CATI  CHECK 

DON'T  KNOW  .  -8  (CATI  CHECK 


Will  tbis  be  full-tiaa  or  part-tiae? 


FULL-TIME  .  1 

PART-TIME  .  2 

REFUSED  . -7 

DON'T  KNOW  .  -8 


CATI  CHECX  4IP1:  IS  YOUTH  PLANNING  TO  BE  WORKING  DURING 
THE  NEXT  FEW  YEARS? 

[IP-1  -  2] 


(CATI  CHECX  *IP2) 
(IP-8) 


♦IP2:  IS  YOUTH  CURRENTLY  WORKING? 

[EE-16  -  1  OR  -7  OR  -8] 


YES  .... 

NO  . 

REFUSED 


(IP-2) 

(IP-8) 

(IP-2) 


:?-2 .  Oo  you  think  that  you  will  be  working  in  the  same  job  or 

occupation  you  now  have,  or  a  different  job  or  occupation? 


SAME  JOB  OR  OCCUPATION  .  1 

DIFFERENT  JOB  OR  OCCUPATION  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


:?-3 .  How  likely  is  it  that  you  will  be  serving  on  active  duty  in  the 
Aray?  Would  you  say — 


definitely  .  1 

probably  .  2 

probably  not,  or  .  3 

definitely  not?  . 4 

REFUSED  .  -7 

DON'T  KNOW  .  . .  -8 


i 


9 


I>  u 
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How  likely  is  it  that  you  will  be  serving  in  the  Aray  Nation. 
Guard?  Would  you  say... 


definitely  .  1 

probably  .  2 

probably  not,  or  .  3 

definitely  not?  .  4 

REFUSED  .  -7 

DON'T  KNOW . . .  -8 


How  likely  is  it  that  you  will  be  serving  in  the  Aray  Reserv 
Would  you  say... 


definitely  .  1 

probably  .  2 

probably  not,  or  .  3 

definitely  not?  .  4 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


OAT I  CHECX  4IP3  :  IS  YOUTH  PLANNING  TO  GO  TO  COLLEGE 
0USINC  THE  NEXT  FEW  YEARS? 
f IP-14  -  1  OR  2} 


YES  .  1  (IP-11A) 

NO  .  2  ( IP— 17 1 


,A.  How  likely  is  it  that  you  will  receive  an  officer's  commiss 
hrough  participation  in  the  Aray  Reserve  Officer's  training 
orps,  that  is,  the  ROTC? 


definitely  .  1 

probably  .  2 

probably  not,  or  . 3 

definitely  not?  .  4 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


13.  :  3UTH  IUESTIONNAIRE  (October  13,  1986)  INTENTIONS  8  PROPENSITY 
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We've  talked  about  several  things  you  sight  be  doing  m  tr.e  next 
few  years.  Taking  everything  into  consideration,  what  are  you 
most  likely  to  be  doing  in  the  (next  year/fall  after  you  finis.-, 
nigh  school)  ?(IF  "GOING  TO  SCHOOL"  OR  "WORKING"  PROBE:  Will  t.nat 
be  full-tise  or  part-tiae?) 

; RECORD  ALL  THAT  APPLY] 


GOING  TO  SCHOOL  FULL-TIME  .  1 

GOING  TO  SCHOOL  PART-TIME  .  2 

WORKING  FULL-TIME  .  3 

WORKING  PART-TIME  .  4 

SERVING  IN  THE  MILITARY  .  .5 

BEING  A  FULL-TIME  HOMEMAKER  .  6 

OTHER  .  7 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


IP-20.  How  likely  is  it  that  you  will  talk  to  someone  [such  as,  family 
friends,  or  teacher]  about  joining  the  Army?  would  you  say... 


definitely  .  1 

probably  .  2 

probably  not,  or  .  3 

definitely  not?  .  4 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


IP-21.  How  likely  is  it  that  you  will  do  something  about  jomir 
Army  (such  as,  see  an  Army  Recruiter,  call  a  toll-free  r 
answer  an  Army  ad,  or  visit  an  Army  base]? 

Would  you  say . . . 


definitely  .  1 

probably  .  2 

probably  not,  or  .  3 

definitely  not?  .  4 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


I.1- 13.  3efore  we  talked  today,  had  you  ever  thought  about  joining  the 
military? 


YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


(GO  TO  BEHAVIORS  MODULE] 


0-29 


■_  V.  V  .-  /  A  A".  A  A.  A.  A.  A.  A.A.WV  A  A.  A.  V. 


V 
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SE-lA.  Have  you  ever  talked  with  any  ailitary  recruiter  to  get 
inf oraation  about  the  ailitary? 


YES  .  1 

NO  .  2 

REFUSED  .  -7 

OON'T  KNOW  .  -3 


BE- 1 . 


In  the  oast  six  Months,  have  you  talked  with  anyone  about 
possibly  joining  the  Aray? 


yes  . 

NO  . 

REFUSED  . . 
DON'T  KNOW 


1  (BE-2) 

2  (BE-10) 

7  (BE-10) 

■8  (BE-10) 


BE-2.  with  whoa  have  you  talked?  [RECORD  ALL  THAT  APPL Y] 


FRIENDS  .  01 

MOTHER  .  02 

FATHER  .  03 

A  BROTHER  OR  SISTER  .  04 

SOME  OTHER  RELATIVE  .  05 

(BOY/GIRL)  FRIEND  OR  SPOUSE  .  06 

A  TEACHER  .  07 

A  COUNSELOR  AT  SCHOOL .  08 

A  RECRUITER  .  09 

CO-WORKER  . .  ,  10 

EMPLOYER  .  11 

OTHERS  .  12 

REFUSED  .  -7 

OON'T  KNOW  .  -8 


CATI  CHECK  #8E1:  WERE  FRIENDS  MENTIONED? 
[BE-2  -  01] 


YES  . .  1  (  8E-3 ) 

W  . . . .  2  ...tCAXI  CHECK  iBE21 


ST 

> 

v 

'j 

“j 


3E- 3.  You  aentioned  talking  with  friends.  (Were  these  friends)  from 
school? 


YES  .  1 

NO  .  2 


BE- 4.  (Were  these  friends)  At  work? 


YES 


1 


;th  ;uesticnnaire  (October  13,  1986) 
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Were  these  friends)  tn  the  service? 


MODULE :  3. 
?<?• 


(BE-6) 

(CATI  CHECK  t 3E2 ) 


were  these  friends)  In  the  Army? 


CATI  CHECK  *BE2:  WAS  RECRUITER  MENTIONED? 
[ BE-2  -  09) 


( BE-8 ) 
(BE-7) 


In  the  tast  six  months.  have  you  talked  to  an  Armed  Ft 
recruiter  about  military  service? 

YES  .  1  (BE-8) 

NO  .  2  (BE-10) 

REFUSED  .  -7  (BE-10) 

DON'T  KHOW .  -9  (BE-10) 


3E-3.  was  the  recruiter  you  spoke  with  an: 


Army  recruiter?  . 

YES 

. . . .  1 

(BE-8A) 

2 

BEI 

-7 

Air  Force  recruiter? 

.  . .  .  1 

(BE-10) 

2 

-7 

Navy  recruiter?  . 

.  . . .  1 

(BE-10) 

2 

-7 

Marine  recruiter?  . .  . 

. . . .  1 

(BE-10) 

2 

-7 

■IS .  .3UTH  QUESTIONNAIRE  (October  13,  1986) 
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3E-3A.  How  did  you  have  your  first  contact  with  the  Aray  recr:: 

Did  you  contact  the  Aray 
recruiter  on  the  advica 

of  another  Service  recruiter .  1 

(Did  you)  contact  the  Aray 

recruiter  first  .  2 

Were  you  contacted  by  the  Aray 

recruiter  first  .  3 

(Ware  you)  with  a  friend  with 
whoa  the  recruiter  was 

Beating  .  4 

Did  you  contact  the  Aray 
recruiter  through  a  us  Aray 
Reserve  or  National  Guard 

unit  or  member,  or  .  S 

Was  your  first  contact  by 

some  other  way  .  6 

REFUSED  .  -7 


DON'T  KNOW  .  -8 


3E-39.  Under  what  circumstances  did  you  first  talk  with  an  Aray 
racruiter?  Oid  you  talk: 

By  telephone  .  l 

At  a  recruiting  station  .  2 

At  a  job  fair  .  3 

At  school  . - .  4 

At  an  Army  Reserve  unit,  or .  5 

Some  other  way  .  6 


REFUSED  .  -7 

DON'T  KNOW  .  -8 


3E-10.  In  the  oast  six  aonthq.  have  you  responded  to  an  Army  ad 
calling  a  toll-free  number  or  sending  for  a  gift? 

YES  .  1 

NO  .  2 

REFUSED .  -7 

OON'T  KNOW  .  -8 


In  the  Qj 
station? 


have  you  visited  an  Army  recruit 


YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 
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3E-13.  In  the  aast  six  months .  have  you  taken  a  written  test  used 
the  Aray,  such  as  the  Araed  Services  Vocational  Aptitude  3a 


YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


CAT I  CHECX  #BE3:  IS  RESPONDENT  CURRENTLY  IN  COLLEGE  OR 
A  COLLEGE  GRADUATE? 

[SC-15  OR  SC-29  -  2  OR  3  OR  IF 
EE-1  >  09] 

YES  . .  1  (CATI  CHECK  *BE4> 

_ MS  . . 2  (  3E-16) _ 


3E-15.  In  the  aast  six  months  have  you  given  any  thought  to  goi.-.g 
college? 


YES  .  1  (BE-17) 

NO  .  2  (CATI  CHECX  *BE4) 

REFUSED  .  -7  (BE-17) 

DON'T  KNOW  .  -8  (BE-17) 


3E-17. 


In  the  aast  six  aonths.  have  you  talked  to' anyone  about  goi 
college? 


YES  . 

NO  . 

REFUSED  . . 
DON’T  KNOW 


1  (BE-18) 

2  ( BE-21) 

7  (BE-21) 

8  (BE-21) 


3E-13.  With  who*  have  you  talked?  (RECORD  ALL  THAT  APPLY] 


FRIENDS  .  01 

MOTHER  .  02 

FATHER  .  03 

A  BROTHER  OR  SISTER .  04 

SOME  OTHER  RELATIVE  .  05 

(BOY/GIRL)  FRIEND  OR  SPOUSE  .  06 

A  TEACHER  .  07 

A  COUNSELOR  AT  SCHOOL .  08 

A  RECRUITER  .  09 

CO-WORXER  .  10 

EMPLOYER  .  11 

OTHERS  .  12 

REFUSED  .  -7 

DON’T  KNOW  .  -8 
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The  Army  College  Fund  . 

The  SI  Sill  . 

ROTC  Scholarships  . 

VEA P  (Veterans  Educational  .  . 
Assistance  Package)  . 


3E-21.  In  the  oast  six  months,  have  you  taken  any  college  admissions 
tests,  for  example,  the  PSAT,  SAT,  or  ACT? 

YES  .  1 

MO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


L,  have  you  submitted  a  college  applicat. 


YES  .  1 

■VO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


CAT I  CHECK  I  BE 4 :  IS  YOUTH  CURRENTLY  EMPLOYED  FULL-TIME?  . 

[EE-16  -  1  AND  EE- 19  >34]  I 

YES  .  1  (SOCIAL  INFLUENCE 

MODULE) 


have  you  given  any  thought  to  gacti.-.c 


YES  . 

NO  . 

REFUSED  . . . 
DON'T  KNOW 


(8E-26) 

(SOCIAL  INFLUENCE  MODULE) 
(BE-26) 

(BE-26) 


3E-26.  In  the  oast  six  months,  have  you  spoken  with  anyone  about  get: 
a  full-time  civilian  30b? 

YES  .  1  (BE-27) 

NO  .  2  ( BE-31) 

REFUSED  .  -7  (BE-31) 

DON'T  KNOW  .  -8  (BE-31) 
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With  whoa  have  you  spoken?  [RECORD  ALL  THAT  APPLY] 

FRIENDS  .  01 

MOTHER  .  02 

FATHER  .  03 

A  3ROTHER  OR  SISTER  .  04 

SOME  OTHER  RELATIVE  .  OS 

(BOY/GIRL)  FRIEND  OR  SPOUSE  .  06 

A  TEACHER  .  07 

A  COUNSELOR  AT  SCHOOL  .  08 

A  RECRUITER  .  09 

CO-WORKER  .  10 

EMPLOYER  .  11 

OTHERS  .  12 

‘  REFUSED  .  -7 

DON’T  KNOW  .  -8 


In  the  oast  six  months,  have  you  visited  any  prospective 
employers  or  employment  agencies? 

YES  .  1 

NO  . 2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


In  the 


I,  have  you  applied  Cor  any  civilian  qods: 


YES  . 

NO  . 

RETUSED  . . . 
DON'T  KNOW 


[GO  TO  SOCIAL  INFLUENCE  MODULE] 
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INTRODUCTION :  Now  I  am  going  to  ask  you  a  few  questions  accut 

the  attitudes  of  your  family  and  friends  amout  the  military 


For  each  of  the  following  people,  please  tell  me  tow  you  thinr. 
they  would  feel  about  your  enlisting  in  the  Army.  Use  a  sca.e  : 
1  to  5  where  a  1  means  they  would  think  it  is  a  very  tad  idea, 
means  its  a  bad  idea,  3  means  its  neither  a  good  nor  a  oad  idea. 
4  means  its  a  good  idea,  and  a  5  means  they  would  think  it  is  a 
very  good  idea. 


'.CODE  6  IF  NOT  APPLICABLE-PERSON  DECEASED,  DOES  NOT  EXIST) 


1  *  VERY  HAD 

2  *  BAD 

3  *  NEUTRAL 

4  *  GOOD 

5  ■*  VERY  GOOD 


Your  father  . 

Your  mother  . 

Friends  with  Army 

experience  . 

Friends  with 
other  military 

experience  . 

Friends  with  no 
military 

experience  . 

Your  school 

counselor  . 

Your  teachers  . . . . 
Your  co-workers  . . 
Your  fellow 
students  . 


Your  employer .  1 


Do  you  have  friends  who  are 


serving  in  the  military* 


YES  .... 

NO  . 

REFUSED 


(SI-3) 

(SI-5) 


-7  (SI-5) 


DON’T  KNOW  .  -8  (SI-5) 


In  what  branch  of  the  military  are  these  friends  serving? 
ALL  THAT  APPLY] 


AIR  FORCE  . . . 

ARMY  . 

COAST  GUARD  . 
KARINE  CORPS 

NAVY  . 

REFUSED  . 

DON’T  KNOW  .  . 
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CAT I  CHECK  ♦SIl:  FRIENDS  IN  ARMY? 

[SI-3  -  2] 

YES  .  1  (SI-4) 

_ NO  .  2  (SI-SI 


Are  your  friends  in  the  Aray  serving  in  the: 


YES 

as 

REF 

Active  Aray  . . . 

1 

2 

-7 

-8 

Aray  Reserve  . 

1 

2 

-7 

-8 

Aray  National  Guard,  or  .. 
Aray  Reserve  Officer's 

1 

2 

-7 

-8 

Training  Corps?  . 

1 

2 

-7 

-3 

Do  you  have  family  members  who  are  currently  serving  in  t.-.e 
military? 


YES  .  1  (SI-6) 

NO  .  2  (IMPORTANCE  MODULE; 

REFUSED  .  -7  (IMPORTANCE  MODULE', 

DON’T  KNOW  .  -8  (IMPORTANCE  MODULE) 


In  what  branch  of  the  military  are  these  family  members  servir 
(CODE  ALL  THAT  APPLY) 


AIR  FORCE  .  1 

ARMY  .  2 

COAST  GUARD  .  3 

MARINE  CORPS  .  4 

NAVY  .  5 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


CAT I  CHECX  »SI2:  FAMILY  IN  ARMY? 

(SI-6  -  2] 


YES  .  1  (SI-7) 

aa  2  ( IKPqRTA^CS  fWOVLE) 


Are  they  serving  in  the: 


YES 

82 

BEE 

OK 

Active  Aray  . 

1 

2 

-7 

-8 

Aray  Reserve  . 

1 

2 

-7 

-8 

Aray  National  Guard,  or  .. 
Army  Reserve  Officer's 
Training  Corps?  . 

1 

1 

2 

2 

-7 

-7 

-8 

-8 

1 


2 


-7  -8 
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(GO  TO  IMPORTANCE  MODULE] 
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IA-1.  In  chinking  about  your  plans  for  the  next  year.  please  tell 
how  important  it  is  that  you  have  opportunities  for  the  foi 
things? 

Use  a  scale  of  1  to  5  where  a  ”1"  means  it  is  not  at  all 
iaportant  and  "3"  aeans  it  is  very  iaportant. 


Having  a  physical  challenge?  . 1 

Working  with  highly  trained 

people?  .  1 

Earning  aoney  for  college 

or  vocational  school?  .  1 

Training  in  useful  skill  areas?  .  1 

Developing  self-confidence?  .  1 

Serving  your  country?  .  1 

Developing  leadership  skills?  ...  1 
A  chance  to  work  with  the  latest 

high-tech  equipment?  .  1 

Having  experiences  you  can 

be  proud  of?  .  1 

Developing  your  potential?  .  1 

Helping  your  career  development?  I 
Serving  your  own  in  community?  .  1 

Having  weekend  excitement?  .  1 

Staying  in  your  own  hommtown?  ...  1 
A  stepping  stone  between  high 

school  and  college?  .  1 

Becoming  sore  mature  and 

responsible? .  1 

The  opportunity  to  make  changes 

and  use  your  own  judgment?  .  1 

Having  a  mental  challenge?  .  1 


[SKIP  TO  MEDIA  HABITS  MODULE] 
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MH-l.  Do  you  regularly  watch  TV? 


YES  .  1  (MH-2 ) 

NO  .  2  (MH-14) 

REFUSED  .  -7  (MH-2) 

DON'T  KNOW  .  -3  (MH-2) 


How  many  hours  per  week  do  you  spend  watching., 
b.  Programs  on  commercial  networks 


Programs  on  commercial  networks 
such  as  ASC,  CSS,  or  NBC? 


♦  HOURS 


a .Programs  on  commercial  cable 
stations  such  as  ESPN,  MTV, 
USA,  or  TBS? 


*  HOURS 


CATI  CHECX  4(0*1: 


IS  CABLE  OR  SUBSCRIPTION  TV  WATCHED? 
[MH-2b  >  0] 


YES  .  1  (MH-11) 


MH-ll.  Do  you  watch  any  of  the  following  Cable  or  Subscription  TV 
channels  regularly? 


YES 

m 

REE 

as 

MTV?  . 

1 

2 

-7 

-9 

Nashville  Network  [TNN ] 

•> 

1 

2 

-7 

-3 

ESPN  [Sports]? 

1 

2 

-7 

-3 

WTBS  [Syndicated]? 

1 

2 

-7 

-3 

Black  Entertainment  TV 

[BET]? 

1 

2 

-7 

-3 

3u  freguently  watch  any 

of  the 

following  types  of 

TV 

XES 

K2 

REE 

as 

Sports?  . 

1 

2 

-7 

-8 

Suspense  or  mystery?  . . 

1 

2 

-7 

-8 

General  drama?  . 

1 

2 

-7 

-8 

Music  or  music  video?  . 

1 

2 

-7 

-8 

Situation  comedy?  . 

1 

2 

-7 

-8 

TV  movies?  . 

1 

2 

-7 

-8 

Talk  shows?  . 

1 

2 

-7 

-8 

w"  ^  v  'w* 
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MH-13 . 

Pleas*  tall  a*  if  you  watch  any  of 

the  following  TV  shows? 

YES  i 4fl 

REF 

David  Lettersan? 

1  2 

-7  -3 

Friday  Might  Videos? 

1  2 

-7  -3 

Monday  Might  Football? 

1  2 

-7  -3 

College  Football? 

1  2 

-7  -3 

Sunday  Might  at  the  Movies? 

1  2 

-7  -3 

MH-14 . 

Does  your  household  hav*  a 

Video  Cassette  Recorder  (VCR) ? 

YES  . 

.  1 

(MH-15) 

MO  . 

(MH-16) 

* 

REFUSED  . 

.  -7 

(MH-16) 

DOM ' T  KNOW  . 

(MH-16) 

MH-15 . 

How 

aany  hours  per  week  do 

you  usually  spend  watching  your  V 

*  HOURS 

MH-16. 

How 

let's  talk  about  radio 

listening 

.  Do  you  regularly  list 

t  hm 

radio? 

YES  . 

(MH-17) 

MO  . 

(MH-2S) 

REFUSED  . 

(HH-28) 

DON'T  KNOW  . 

(MH-28) 

MH-17 . 

How  aany  hours  p«r  week  do 

you  listen  to  . . 

a.  AM  Radio? 

»  HOURS 

b.  FM  Radio? 

*  HOURS 

MH-25. 

DO 

you  frequently  listen  to 

any  of  the  following  types  of  ra 

proqraas? 

YES 

NO  SET 

2JS 

News?  . 

1 

2  -7 

-a 

Classical  ausic?  . 

1 

2  -7 

-8 

Pop?  . 

1 

2  -7 

-8 

Country?  . . . . . 

1 

2  -7 

-8 

Sports?  . 

1 

2  -7 

-a 

Talk  Shows?  . 

1 

2  -7 

-8 

Rock  6  Roll?  . 

1 

2  -7 

-8 

"Easy  Listening"?  .... 

1 

2  -7 

-8 
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Amarican  Top  40? 

YES 

1 

2 

REF 

-7 

-8 

King  Biscuit  Flowar  Hour? 

1 

2 

-7 

-3 

Rick  Daas 1  Top  40? 

1 

2 

-7 

-8 

Matalshop? 

1 

2 

-7 

-8 

RocXlina? 

1 

2 

-7 

-3 

MH-23.  How  oftan  do  you  raad  tha  nawspapar?  Is  it... 

navar,  .  1  (MH-31) 

lass  than  twica  a  waak .  2  (MH-29) 

2-3  timas  par  waaX,  .  3  (MH-29) 

•  4-5  timas  par  waaX,  or . 4  (MH-29) 

daily?  . .  5  (MH-29) 

REFUSED  . -7  (MH-31) 

DON’T  KNOW  . .  -8  (MH-31) 

MH-29.  How  aany  hours  do  you  spand  raading  tha  nawspapar  aach  wee<? 


*  HOURS 


MH-30.  Do  you  ragularly  raad  any  of  tha  following  sactions? 


Sports?  . . . 
Comics?  . . . 
Naws?  . 

Local?  .... 

Food?  . 

Lifastyla? 

CLassifiad? 


Finally,  I  would  liXa  to  discuss  magazina  raadership. 
ragularly  raad  sagazinas? 


YES  . 

NO  . 

REFUSED  . . . 
DON’T  KNOW 


(MH-32 ) 

(RECALL  MODULE) 
(RECALL  MODULE) 
(RECALL  MODULE) 
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MH-32.  What  magazines  do  you  read  on  a  regular  basis,  that  is,  those 
that  you  have  read  at  least  3  of  the  past  4  issues? 


REFUSED  .  -7 

DON'T  KNOW  .  -3 


MH-33.  About  how  many  hours  a  week  do  you  spend  reading  magazines? 


4  HOURS 


[GO  TO  KNOWLEDGE-RECALL  NODDLE] 
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Now,  thinlcing  about  TV,  radio,  newspapers,  magazines,  and  any 
other  sources  of  advertising,  for  what  military  service  or 
services  do  you  recall  seeing  or  hearing  any  advertising? 
(PROBE:  Any  other  services?) 

[RECORD  ALL  THAT  APPLY.] 


NONE  .  0 

AIR  FORCE .  1 

ARMY  .  2 

RESERVE  OFFICER'S  TRAINING 

CORPS,  or  R.O.T.C .  3 

NATIONAL  GUARD  .  * 

RESERVE  .  5 

COAST  GUARD  .  6 

MARINE  CORPS  .  7 

NAVY  . 8 

ONE  AO  FOR  ALL  SERVICES  .  9 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


(KR- 5) 

(CATI 

CHECK 

4KP.5  , 

(CATI 

CHECK 

4KR6; 

(CATI 

CHECK 

4KRI, 

(CATI 

CHECK 

4KR2) 

(CATI 

CHECK 

4KR3  ; 

(CATI 

CHECK 

4KR13, 

(CATI 

CHECK 

4KR11. 

(CATI 

CHECK 

SKR12  , 

(CATI 

CHECK 

*  KR4  , 

(KR-5) 

(KR-5) 

ATI  CHECK  *KR1: 


WAS  R.O.T.C, 
(KR-1  -  3] 

YES  . 

NO  . 


MENTIONED? 


(KR-2) 

(CAT!  CHECK  #KR2) 


You  mentioned  seeing  or  hearing  advertising  for  the  Reserve 
Officer's  Training  Corps.  For  which  military  service  or  serv 
was  this  advertising?  [RECORD  ALL  THAT  APPLY) 


AIR  FORCE  .  1 

ARMY  .  2 

NAVY  .  3 

MARINE  CORPS  . ; .  .  .  4 

COAST  GUARD  .  5 

REFUSED  .  -7 

DON’T  KNOW  .  -8 
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ATI  CHECX  ♦KRS :  DID  RESPONDENT  RECALL  SEEING  OR  HEARING 
AN  AD  FOR  THE  ARMY? 

[KR-1  -  2] 


YES  .  1  (CATI  CHECK  *KR7) 


[Do  you  recall  seeing  or  hearing  any  advertising  for]  The  Amy 


YES  . 

NO  . 

REFUSED  .  .  . 
OOM'T  KNOW 


ATI  CHECK  #KR7:  DID  RESPONDENT  RECALL  SEEING  OR  HEARING 
AN  AD  FOR  THE  ARMY  R.O.T.C.? 

[KR-2  -  2] 

YES  .  1  (CATI  CHECX  #KR8) 


[Do  you  recall  seeing  or  hearing  any  advertising  Cor]  The  A 
Reserve  Officer's  Training  Corps,  that  is,  the  Aray  r.o.t.c 

YES  .  X 

NO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


ATI  CHECX  ♦KR8:  DID  RESPONDENT  RECALL  SEEING  OR  HEARING 
AN  AD  FOR  THE  ARMY  NATIONAL  GUARD? 

(KR-3  -  2] 

YES  .  1  (CATI  CHECK  #KR9) 


[Do  you  recall  seeing  or  hearing  any  advertising  for]  The  Amy 
National  Guard? 


YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 
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CATI  CHECK  4KRI2:  DID  RESPONDENT  RECALL  SEEING  OR  HEARING 
AN  AD  FOR  THE  NA-.  Y? 

;kr-i  -  a] 


YE S  .  1  (CATI  CHECK  *KR13) 

.  . 2 :kr-ui _ 


KR-12 .  Do  you  recall  seeing  or  hearing  any  advertising  for;  The  Navy’ 


YES  .  1 

NO  .  2 

REFUSED  . -7 

DON'T  KNOW  .  -8 


CATI  CHECK  *KS13:  DID  RESPONDENT  RECALL  SEEING  OR  HEARING 
ONE  AD  FOR  ALL  THE  SERVICES? 


[ KR-1  -  9] 

FES  .  1  (CATI  CHECK  #KR14) 

ug ,2 _ LSBcUJ _ 


<R-'.3.  ;Do  you  recall  seeing  or  hearing  any  advertising  for’  Ail  the 
services  in  on*  ad? 


yes  .  i 

NO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


l 


CATI  CHECK  *KR14:0ID  RESPONDENT  RECALL  SEEING  OR  HEARING 
ARMY  OR  ARMY  COMPONENT  AD? 

C  KR-1  »  2]  ,  OR 

(KR-2,  OR  KR-3  OR  KR-4  -  2]  OR 
(KR-6,  OR  KR-7,  OR  KR-3,  OR  KR-9  -  i; 


YES 


1  (KR-1*) 
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Did  you  see  or  hear  Aray  ads... 


On  TV?  . 

on  the  radio?  . 

In  aagazmes?  . 

In  newspapers?  . 

On  billboards?  . 

Through  the  sail?  . 

On  posters?  . . . 

In  brochures  or  paaphlets? 

In  the  Yellow  Pages?  . 

Somewhere  else?  . 


ATI  CHECX  *KR15:  DID  RESPONDENT  RECALL  SEEING  OR  HEARING 
AN  ARMY  AD  (UNAIDED  OR  AIDED)? 

[KR-l  »  2  OR  KR-6  -  1] 


(KR-15) 


Other  than  trying  to  get  you  to  enlist,  what  was  the  sain  tessac 
you  got  Jroa  Aray  advertising? 


HECK  4KR16 :  DID  RESPONDENT  RECALL  ANY  ADS  OTHER 
THAN  THE  ARMY  AD? 

[KR-1  »  1,  3,  4,  5,  6,  7,  3  OR  9]  OR 
(KR-5,  OR  KR-7,  OR  KR-8 ,  OR  KR-9 ,  OR  KR-10 
OR  KR-11,  OR  KR-12,  OR  KR-13  -  1] 

YES  .  1  (CATI  CHECX  4KR17) 

NO  .  2  (ATTITUDES  MODULE) 


♦KR17:  RANDOMLY  SELECT  SERVICE  OR  SERVICE 

COMPONENT  OR  JOINT  SERVICES  AD  FROM  THOSE 


XR- 17.  Other  than  trying  to  get  you  to  enlist,  what  was  the  aam  aessaae 
you  got  fro*  ( SERVICE /SERVICE  COMPONENT)  advertising? 
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DAT I  CHECK  SAT1:  DID  RESPONDENT  RECALL  SEEING  CR  HEARING 
ARMY  ADS? 


(KR-1  -  2  OR  KR-6  -  1] 

YES  .  1  (AT-1) 

NO  .  2  (SLOGAN  MODULE) 


Use  a  scale  or  *1"  to  "5"  where  "1"  leans  you  do  not  like  the 
advertising  and  "5"  leans  you  like  the  advertising  very  nuc.n. 

Overall,  how  auch  do  you  like  the  Aray  ads  you  have  seen  or  tea 
over  the  past  year? 


DO  NOT  LIXE  .  1 

SOMEWHAT  DISLIKE  .  2 

NEUTRAL  .  3 

LIKE  SOMEWHAT  .  4 

LIKE  VERY  MUCH  .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


Use  a  scale  or  "l"  to  “5"  where  "l"  means  you  do  not  believe  t.t 
advertising  and  "a"  means  you  believe  the  advertising  very  much 

How  auch  do  you  believe  what  the  ads  say? 


DO  NOT  BELIEVE  .  1 

SOMEWHAT  OISBELIEVE  .  2 

NEUTRAL  .  3 

BELIEVE  SOMEWHAT  .  4 

STRONGLY  BELIEVE  .  5 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


(GO  TO  SLOGAN  RECOGNITION  MODULE] 


I  am  going  Co  mention  son*  slogans  used  by  the  military  in  :• 
advertising.  After  I  read  each  slogan,  please  tall  ae  vhethi 
is  used  by  the  (RANDOMISED  LIST  OF  SERVICES) ,  or  by  all  four 
active  duty  services  together  in  the  same  ad  or  commercial. 


Which  military  service  uses  the  advertising  slogan,  "Blank, 
not  just  a  job.  It's  an  adventure."? 


AIR  FORCE  .  1 

ARMY  .  2 

MARINE  CORPS  .  3 

NAVY  .  * 

ALL  FOUR  SERVICES  IN  SAME  AD  .  5 

REFUSED  .  -? 

DON'T  KNOW  .  -8 

•Which  military  service  uses  the  advertising  slogan, ;  "The  ?• 
The  Proud.  The  BlanJt."? 

AIR  FORCE  .  1 

ARMY  . .  2 

MARINE  CORPS  .  3 

NAVY  .  4 

ALL  FOUR  SERVICES  IN  SAME  AD .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


rWhich  military  service  uses  the  advertising  slogan, ;  "Be  a*, 
can  be."? 


AIR  FORCE  .  1 

ARMY  .  2 

MARINE  CORPS  .  3 

NAVY  .  4 

ALL  FOUR  SERVICES  IN  SAME  AD .  5 

REFUSED  .  -7 

DON'T  KNOW .  -8 


(Which  military  service  uses  the  advertising  slogan, ]  "Blank 
great  way  of  life."? 


AIR  FORCE  .  1 

ARMY  .  2 

MARINE  CORPS  .  3 

NAVY  .  4 

ALL  FOUR  SERVICES  IN  SAME  AD  .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -8 
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(Which  ailitary  service  uses  the  advertising  slogan, ; 
looking  for  a  few  good  sen. "? 

AIR  FORCE  .  1 

ARMY  .  2 

MARINE  CORPS  .  3 

NAVY  .  4 

ALL  FOUR  SERVICES  IN  SAME  AD  .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -8 

[Which  ailitary  service  uses  the  advertising  slogan, ; 
great  place  to  start.*? 

•  AIR  FORCE  .  1 

ARMY  .  2 

MARINE  CORPS  .  3 

NAVY  .  4 

ALL  FOUR  SERVICES  IN  SAME  AD  .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -3 


Blank."? 

AIR  FORCE  .  I 

ARMY  .  2 

MARINI  CORPS  .  3 

NAVY  .  4 

ALL  FOUR  SERVICES  IN  SAME  AD .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -8 

[Which  ailitary  service  uses  the  advertising  slogan, [ 
a  company,  we're  your  country."? 

AIR  FORCE  .  1 

ARMY  .  2 

MARINE  CORPS  .  3 

NAVY  .  4 

ALL  FOUR  SERVICES  IN  SAME  AD  .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


(GO  TO  PERCEPTIONS  MODULE] 
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11- 

i 

I  aa  going  to  read  you  a  list  a;  statements 

iescr 

ibing 

diff 

things  the  Army  might  offer.  Pleas*  tall  a* 

how 

much 

you 

disagree  or  agree  that  the  Army  offers 

each 

item 

on 

zh 

e  lis 

"1" 

means  you  disagree  completely,  a  ■ 2 

"  means  you 

disagree 

ccaewhat,  a  "3"  means  you  neither  agree 

nor 

disagree, 

a  "  4  '* 

you 

agree  somewhat  and  a  "5"  means  you 

agre« 

complete! 

as 

&  S 

The 

Army  offers. . . 

A. 

a  wide  variety 

of  opportunities  to  find  a 

job  you  can  enjoy? 

1 

2 

3 

4 

5 

3'. 

a  physically  challenging 

environment? 

1 

2 

3 

4 

5  - 

C. 

an  experience  you  can  be  proud  of? 

1 

2 

3 

4 

5 

3. 

an  advantage  over  going 

right  from  high  school  to  college 

? 

2 

3 

4 

5 

£. 

an  opportunity 

to  develop  leadership  skills? 

1 

2 

3 

4 

5  - 

F . 

the  chance  to 

work  with  the  latest 

high  tech  equipment? 

1 

2 

3 

4 

5  - 

G. 

a  great  value  in  your 

civilian  career  development? 

1 

2 

3 

4 

5  - 

H. 

an  excellent  opportunity  to 

develop  self-confidence? 

1 

2 

3 

4 

5  - 

I. 

the  opportunity  to 

develop  your  potential? 

1 

2 

3 

4 

5  - 

J. 

a  mentally  challenging 

experience? 

1 

2 

3 

4 

5  - 

K. 

an  opportunity  for  you  to  become 

more  mature  and  responsible? 

1 

2 

3 

4 

5  - 

L. 

many  opportunities  for  training  in 

useful  skill  areas? 

1 

2 

3 

4 

5 

M. 

many  chances  to  work  with  highly 

trained  peop.e? 

1 

2 

3 

4 

5  - 

M. 

an  excellent  opportunity  to  obtain 

money  for  a  college  or  vocational 

education? 

1 

2 

3 

4 

5  - 
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OAT I  CHECK  *PE2:  RANDOMLY  SELECT  A  CAREER  OPTION  FROM 
ARMY  RESERVE,  ARMY  NATIONAL  GUARD, 
AIR  FORCE,  NAVY,  MARINE  CORPS,  GOING 
TO  COLLEGE,  WORKING  IN  A  FULL-TIME 
CIVILIAN  JOB,  ALL  SERVICES. 

4PE3 :  ’WHICH  CAREER  OPTION  WAS  SELECTED? 


ARMY  RESERVE  .  1  (PE-1A) 

ARMY  NATIONAL  GUARD  .  2  (PE-4 A) 

AIR  FORCE  .  3  (PE-6) 

NAVY .  4  (PE-6) 

MARINE  CORPS  .  5  (PE-6) 

ALL  SERVICES  .  6  (PE-6) 

WORKING  IN  A  FULL-TIME 

CIVILIAN  JOB  .  7  (PE-7) 

GOING  TO  COLLEGE  .  3  (PE-8) 


Have  you  ever  heard  of  the  United  States  Amy  Reserve? 


YES  . 

NO  . 

REFUSED  . 

DON'T  KNOW  . . . 


1  (PE-4) 

2  (PE-4A) 
-7  (PE-4A) 
-8  (PE-4) 


IS-tiO 


3CM.S:  t  Z  UTH  QUESTIONNAIRE  (October  13,  1936) 
:m3  =  3 " 32 -00 "7  expiration  31  August,  1989 


PERCEPTIONS/ 3ELIEFS 
pg.  U-3 


Now,  I  am  going  to  read  you  a  list  of  tilings  ths  United  States 
Army  Reserve  sight  offer.  Please  tall  se  how  such  you  disagree 
or  agree  that  the  United  States  Aray  Reserve  offers  each  :tea  tr 
the  list.  Again,  a  "l*  aeans  you  disagree  completely,  a  "3" 
means  you  disagree  somewhat,  a  "3"  means  you  neither  agree  tor 
disagree,  a  "4"  means  you  agree  somewhat  and  a  "5"  means  you 
agree  completely. 

The  United  States  Any  Reserve  offers: 


A.  a  wide  variety  of  opportunities 
to  find  a  job  you  can  enjoy? 

3.  an  experience  you  can  be  proud  of? 

C.  an  opportunity  to  develop 
leadership  skills? 

0.  a  great  value  in  your  civilian  career 
development? 

£.  an  excellent  opportunity  to  develop 
self -confidence  ? 

?.  the  opportunity  to  develop  your 
potential? 

3 ■  a  mentally  challenging  experience? 

H.  the  opportunity  to  become  sore 

mature  and  responsible? 

I.  many  opportunities  for  training  in 

useful  skill  areas? 


J.  aany  chances  to  work  highly  trained 

people? 

K.  an  excellent  opportunity  to  obtain 

money  for  a  college  or  vocational 
education? 


L.  an  opportunity  to  serve  America  while 

staying  in  your  own  home?  i  2 

M.  a  chance  to  serve  your  own 

community? 

N.  interesting  and  exciting 

weekends? 


[SKIP  TO  PE-12] 
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Mow ,  I  am  going  to  read  you  a  list  of  statements  describing 
different  things  the  United  States  Army  National  Guard  mgnt 
offer.  Please  tall  aa  how  auch  you  disagree  or  agree  that  th 
United  States  Army  National  Guard  offers  each  item  on  the  lis 
Again,  a  "1"  means  you  disagree  completely,  a  "2"  means  you 
disagree  somewhat,  a  "3*  leans  you  neither  agree  nor  disagree,  a 
"4"  means  you  agree  somewhat  and  a  "5"  means  you  agree 
completely. 


The  Army  National  Guard  offers: 


A.  a  wide  variety  of  opportunities 
to  find  a  job  you  can  enjoy? 

3.  an  experience  you  can  be 
proud  of? 

C  an  opportunity  to  develop 
leadership  skills? 

0.  a  great  value  in  your  civilian 
career  development? 

E.  an  excellent  opportunity  to  develop 

self-confidence? 

F.  the  opportunity  to  develop  your 

potential? 

G.  .a  mentally  challenging  experience? 

H.  an  opportunity  to  become 

more  mature  and  responsible? 

I.  many  opportunities  for  training  in 

useful  skill  areas? 

J.  many  chances  to  work  with  highly 

trained  people? 

:<.  an  excellent  opportunity  to  obtain 
money  for  a  college  or  vocational 
education? 

L.  an  opportunity  to  serve  America 

while  staying  in  your  own  home? 

M.  a  chance  to  serve  your 

own  community? 

M.  gives  you  interesting  and  exciting 
weekends  ? 


as 

i 


2  3 


12 
4  5 


1  2  3  4  5 


1  2  3  4  5  -7 


1  2  3  4  5 


1  2  3  4  5 


1  2  3  4  5  --! 


1  2  3  4  5 


1  2  3  4  5 


1  2  3  4  5  -7 


1  2  3  4  5  -7  -6 


-3 


-  5 


1  2  3  4  5 

1  2  3  4  5 


-7  -6 


-7  -8 
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B-63 


V,V  '«V, 


(t  (D 


r> 


,-w  .  .  .■VVYw*  -  •  \.V 


NJTH  IVESTIONNAIRE  (October  13,  1986) 
30?"  expiration  31  August,  1989 


PERCEPTIONS/ BELIEFS 
pg.  11-8 


I  am  going  to  read  you  a  list  of  statements  describing  differs: 
tilings  the  (SERVICE)  might  offer.  Please  tell  me  now  much  you 
disagree  or  agree  that  the  (SERVICE)  offers  item  on  the  list. 
Again,  a  "1"  means  you  disagree  completely,  a  ”2"  means  you 
disagree  somewhat,  a  "3"  means  you  neither  agree  nor  disagree. 
"I"  means  you  agree  somewhat  and  a  "5"  means  you  agree 
completely . 


The  (SERVICE)  offers: 


a  wide  variety 
of  opportunities  to  find  a 
job  you  can  enjoy? 


9.-  a  physically  challenging 
environment? 


an  experience  you  can  be 
proud  of? 


an  advantage  over  going  right 
from  high  school  to  college? 


an  opportunity  to  develop 
leadership  skills? 


the  chance  to  work  with 
the  latest  high  tech  equipment? 


a  great  value  in  your  civilian 
career  development? 


an  excellent  opportunity  to  develop 
self-confidence? 


the  opportunity  to  develop  your 
potential? 


J.  a  mentally  challenging  experience? 


an  opportunity  to  become 
more  mature  and  responsible? 


L.  many  opportunities  for  training  in 
useful  skill  areas? 


M.  many  chances  to  work  with  highly 
trained  people? 


M.  an  excellent  opportunity  to  obtain 
money  for  a  college  or  vocational 
education? 


( SKIP  TO  PE-12] 
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I  am  going  Co  read  you  a  list  of  statements  describing  different 
things  working  in  a  full-time  civilian  job  might  offer.  Please 
tall  me  how  much  you  disagree  or  agree  that  working  in  a  full¬ 
time  civilian  job  offers  each  item  on  the  list.  Again,  a  "1" 
means  you  disagree  completely,  a  "2"  means  you  disagree  somewr.at 
a  "3"  means  you  neither  agree  nor  disagree,  a  "a"  means  you  agr° 
somewhat  and  a  "5"  means  you  agree  completely. 


Working  in  a  full-time  civilian  job  offers: 


A.  a  physically  challenging 
environment? 

3.,  an  experience  you  can  be  proud  of? 

C.  an  advantage  over  going 

right  from  high  school  to  college? 

3.  an  opportunity 

to  develop  leadership  skills? 

E.  the  chance  to  work  with 

the  latest  high  tech 
equipment? 

F.  a  great  value  in  your 

civilian  career  development? 

<3.  an  excellent  opportunity 

to  develop  self-confidence? 

H.  the  opportunity  to 

develop  your  potential? 

I.  a  mentally 

challenging  experience? 

J .  the  opportunity  to  become  more 

more  mature  and  responsible? 

K.  many  opportunities  for 

training  in  useful  skill  areas? 

L.  many  chances  to  work  with  highly 
trained  people? 

M.  an  excellent  opportunity  to 
obtain  money  for  a  college  or 
vocational  education? 


[ SKIP  TO  PE-12] 
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I  am  going  to  read  you  a  list  of  statements  describing  d. 
things  going  to  college  might  offer.  Please  tell  me  now 
disagree  or  agree  that  going  to  college  offers  each  item 
list.  Again,  a  "1"  means  you  disagree  completely,  a  "2" 
you  disagree  somewhat,  a  "3"  means  you  neither  agree  ncr 
disagtae,  a  "4"  means  you  agree  somewhat  and  a  ''5"  means 
agree  completely. 

Going  to  college  offers... 


an  experience  you  can  be 
proud  of? 

an  opportunity  to  develop 
leadership  skills? 

a  great  value  in  your  civilian  career 
development? 

an  excellent  opportunity  to  develop 
self-confidence? 

the  opportunity  to  develop  your 
potential? 

a  mentally  challenging  experience? 

the  opportunity  to  become 

more  mature  and  responsible? 

many  chances  to  work  with  highly 
trained  people? 


PE- 22.  Of  the  people  who  joined  the  Army  in  the  last  year,  what 

proportion  do  you  think  are  high  school  diploma  graduates? 
you  say. . . 

less  than  one  quarter,  .  1 

about  one  quarter,  .  2 

about  one  half .  3 

about  three  quarters,  or  .  4 

almost  all?  .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


£11  II 
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PS- 13 .  Of  the  people  who  joined  ths  Army  last  year,  what  proportion  Co 
you  thinJc  would  scors  in  ths  uppsr  half  of  an  intelligence  oast? 
Is  it... 


all  of  them . 

three  quarters  of  them, 

half  of  thaa . 

ona  quarter  of  thaa,  or 

none  of  thaa?  . 

REFUSED  . 


OON'T  KNOW  .  -3 


PE-14.  Of  the  people  who  joined  the  Aray  in  the  last  year,  what 

proportion  do  you  think  will  gat  a  collage  diploma  either  while 
they  are  in  the  Army  or  after  they  coaplata  their  Army  service? 
Would  you  say... 

less  than  one  quarter .  1 

about  one  quarter .  2 

about  one  half,  .  3 

about  three  quarters,  or .  4 

almost  all?  .  5 

REFUSED  .  -7 

OON'T  KNOW  .  -8 

PE-15.  Do  you  thinJc  very  many  young  (aen/woaen)  with  backgrounds  and 
plans  for  the  future  like  (YOUTH)  are  joining  the  Aray? 

YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


CAT I  CHECK  4 PEI:  IS  YOUTH  ROTC  POTENTIAL? 


1  ( PE-15A) 

2  ( KNOWLEDGE  AWARENESS 


PE-15A.  Have  you  ever  heard  of  the  Aray  Reserve  Officer's  Training 
Corps  on  a  collage  campus? 

YES  .  1  (PE-2) 

NO  .  2  (KNOWLEDGE-AWARENESS 

MODULE) 

REFUSED  .  -7  (KNOWLEDGE- AWARENESS 

MODULE) 

DON'T  KNOW  ..  -3  (PE-2) 


i 


EC 


V>.  V? 


V.  .*  V.  / 
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PE-2.  Next,  I  will  read  you  a  few  statements  describing  different 
things  that  the  Army  Reserve  Officer's  Training  Corps  on  the 
college  campus  might  offer.  Please  tell  me  how  much  you  disagree 
or  agree  that  being  an  officer  offers  each  item  on  the  list.  A 
"1"  means  you  disagree  completely,  a  "2"  means  you  disagree 
somewhat,  a  "0"  means  you  neither  agree  nor  disagree,  a  "4"  -ears 
you  agree  somewhat  and  a  "5"  means  you  agree  completely. 

The  Army  Reserve  Officer's  Training  Corps  on  the  college  campus 
provides. . . 


A£  2Ji£  21 


A.  leadership  and 

•  management  training? 

3.  the  opportunity  to  develop 
self-confidence? 

C.  a  college  elective  that 

can  be  taken  together  with  other 
collage  courses? 

0.  an  officer's  commission 

in  the  active  Army,  Army  Reserve, 
or  the  Army  National  Guard? 


12  3  4  5 


1  2  3  4  5  -7 


1  2  3  4  5 


1  2  3  4  5 


Being  an  officer  in  the  United  States  Army  means  different  things 
to  different  people.  Please  tell  me  how  such  you  disagree  or 
agree  that  being  an  officer  offers  each  item  on  the  list.  A  "1” 
means  you  disagree  completely,  a  "2*  means  you  disagree  somewr.at. 
a  "3"  means  you  neither  agree  nor  disagree,  a  **”  means  you  agree 
somewhat  and  a  "3"  means  you  agree  completely. 


Being  an  officer  in  the  United  States  Army  provides... 


&£  ELI  IK 


A.  a  vide  variety  of 

job  opportunities? 

a.  experiences  you  can  be  proud  of? 

C.  the  opportunity  to  use  your  college 
acquired  skills? 

□.  the  opportunity  to  make  changes  and 
use  your  own  judgment? 


1  2  3  4  5 


1  2  3  4  5  -7 


1  2  3  4  5  -7 


1  2  3  4  5  -7 
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KA-'.  Can  you  become  aligibla  to  aam  aoney  for  collaga  by  enlisting 
the  Aray? 

YES  .  1  (KA-1) 

MO  .  2  (CATI  CHECK  4KA4, 

REFUSED  .  -7  (KA-1) 

DON’T  KNOW  .  -8  (KA-1) 

KA-1.  How  auch  do  you  think  can  b«  aamad  through  Aray  education 

benefits?  [PROBE:  This  would  be  the  total  education  benefits 
that  could  ba  earned  while  in  the  Aray.] 


UNDER  $5,000  .  1 

$5,000  TO  $9,999  .  2 

$10,000  TO  $14,999  .  3 

S15,000  TO  $19,999  .  4 

$20,000  TO  $24,999  . .  5 

$25,000  OR  MORE  .  6 


REFUSED  .  -7 

DON’T  KNOW  .  -8 


KA-2.  Do  you  think  Aray  education  benefits  would  cover  your  entire 
collaga  education? 

YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON’T  KNOW  .  -8 

KA- 3 .  Do  you  think  Aray  education  benefits  are  aore,  lass  or  about  the 
sane  as  the  Navy,  Air  Force,  or  Marines  offer? 


MORE  . 

LESS  . 

ABOUT  THE  SAME 
REFUSED  . 


DON’T  KNOW  .  -8 


Please  tell  ae  whether  or  not  each  of  the  following  services 
offers  the  "GI  Bill"? 


Aray . 

Air  Force 

Navy  . 

Marines  . . 


DOES 

VITER 

l 

l 

l 

l 


DOES 

NOT 

7FFER 

2 

2 

2 

2 


:*  n 
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KA-5.  What  is  the  minimum  number  of  years  that  a  new  recruit  has 
serve  on  active  duty  in  the  Army? 


REFUSED  . . . 
DON'T  KNOW 


KA-o .  Is  it  possible  to  sign  up  for  the  Army  and  actually  start  serv 
up  to  one  year  later? 

YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 

KA-8.  Are  17  year  old  high  school  juniors  eligible  to  join  the  Aav 
Reserve  or  Army  National  luard? 

YES  .  1  (KA-10) 

NO  .  2  (KA-9) 

REFUSED  .  -7  (KA-9) 

DON'T  KNOW  .  -8  (KA-9) 

KA-9.  Is  high  school  graduation  required  before  joining  the  Army 
Reserve  or  Army  National  Guard? 

YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON’T  KNOW  .  -8 

KA-10.  who  sponsors  the  "Scholar-Athlete  Award  Program"?  Is  it  the. . 

Marine  Corps .  1 

National  Guard .  2 

Army  Reserve .  3 

Air  Force, or  .  4 

Navy?  .  5 

REFUSED  .  -7 

DON’T  KNOW  .  -8 

KA-11.  Can  qualified  people  who  join  the  Army  Reserve  or  Army  Nationa 
Guard  receive  money  for  collage? 

YES  .  1  (KA-12 ) 

NO  .  2  (KA-13) 

REFUSED  .  -7  (KA-12) 

DON'T  KNOW  .  -8  (KA-12) 


to 
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INTRODUCTION :  Now  I  have  sons  questions  about  your  background. 


CATI  CHECX  *DE1:  IS  RESPONDENT  HISPANIC? 

[SC-20  OR  SC-34  -  1] 

YES  .  1  (OE-5) 

_ NO  .  2 _ f  DE-6 ) 


OE-5.  What  is  your  ethnic  background?  Ars  you: 


Mexican  Aasrican  . . . . 
Puerto  Rican,  or  .... 
Some  other  Hispanic? 
REFUSED  . 


DON'T  KNOW  .  -8 


3E-o .  vhat  is  your  current  aarital  status?  Are  you: 

Single .  1 

Married .  2 

Separated .  3 

Divorced,  or  .  4 

Widowed?  .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


INTRODUCTION:  Now  I  would  like  to  ask  soae  questions  about  your  lather 

and  mother,  or  other  adults  in  your  household. 

DE-I4.  (When  not  attending  college)  Do  you  live  in  the  same  householi  as 
one  or  both  of  your  parents?  (Please  include  any  natural 
parents,  step-parents  or  guardians.) 

YES  .  1  (DE-15) 

NO  .  2  ( DE-16 ) 

REFUSED  .  -7  (DE-16) 

DON’T  KNOW  .  -8  (DE-15) 

DE-1S.  which  of  your  parents  do  you  live  with? 


BOTH  . 

MOTHER,  STEP-MOTHER  OR  FEMALE  GUARDIAN. 
FATHER,  STEP-FATHER  OR  MALE  GUARDIAN... 

REFUSED  . 

DON'T  KNOW  . . . 
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DE-16 .  who  is  the  principal  wage  earner  in  the  household? 

BOTH  .  1 

MOTHER,  STEP-MOTHER  OR  FEMALE  GUARDIAN . .  2 

FATHER,  STEP-FATHER  OR  MALE  GUARDIAN _  3 

OTHER  .  4 

NO  WAGE  EARNER  .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -3 


DE-19.  What  was  the  highest  grade  or  level  of  education  that  your  fat.-.e: 
completed? 

LESS  THAN  8TH  GRADE  .  07 

8TH  GRADE  .  08 

9TH  GRADE  .  09 

10TH  GRADE  .  10 

11TH  GRADE  .  11 

12TH  GRADE  .  12 

1ST  YEAR  OF  4 -YEAR  COLLEGE  .  13 

2ND  YEAR  OF  4-YEAR  COLLEGE  .  14 

3RD  YEAR  OF  4 -YEAR  COLLEGE  .  15 

4TH  YEAR  OF  4-YEAR  COLLEGE  . ...  16 

STH  'YEAR  COLLEGE/ 1ST  YEAR 
GRADUATE  OR  PROFESSIONAL  SCHOOL  ....  17 
2ND  YEAR  GRADUATE  OR 

PROFESSIONAL  SCHOOL  .  18 

3RD  YEAR  GRADUATE  OR 

PROFESSIONAL  SCHOOL  .  19 

MORE  THAN  3  YEARS  GRADUATE/ 

PROFESSIONAL  SCHOOL  .  20 

1ST  YEAR  OF  JR.  OR  COMMUNITY 

COLLEGE  .  21 

2ND  YEAR  OF  JR.  OR  COMMUNITY 

COLLEGE  .  22 

1ST  YEAR  OF  VOCATIONAL, 

BUSINESS  OR  TRADE  SCHOOL  .  23 

2ND  YEAR  OF  VOCATIONAL, 

BUSINESS  OR  TRADE  SCHOOL  .  24 

MORE  THAN  2  YEARS  VOCATIONAL, 

BUSINESS  OR  TRADE  SCHOOL  .  25 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


■ 
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2E- 2 6 .  what  was  the  highest  grade  or  level  of  education  that  you 
completed? 

LESS  THAN  8TH  GRADE  .  07 

3TH  GRADE  .  08 

9TH  GRADE  .  09 

I0TH  GRADE  .  10 

11TH  GRADE  .  11 

12TH  GRADE  .  12 

1ST  YEAR  OF  4 -YEAR  COLLEGE  .  13 

2ND  YEAR  OF  4-YEAR  COLLEGE  .  14 

3RD  YEAR  OF  4-YSAR  COLLEGE  .  15 

4TH  YEAR  OF  4-YSAR  COLLEGE  .  16 

5TH  YEAR  C0LLEGE/1ST  YEAR 
GRADUATE  OR  PROFESSIONAL  SCHOOL  ....  17 
2ND  YEAR  GRADUATE  OR 

PROFESSIONAL  SCHOOL  .  18 

3RD  YEAR  GRADUATE  OR 

PROFESSIONAL  SCHOOL  .  19 

MORE  THAN  3  YEARS  GRADUATE/ 

PROFESSIONAL  SCHOOL  .  20 

1ST  YEAR  OF  JR.  OR  COMMUNITY 

COLLEGE  .  21 

2ND  YEAR  OF  JR.  OR  COMMUNITY 

COLLEGE  .  22 

1ST  YEAR  OF  VOCATIONAL, 

BUSINESS  OR  TRADE  SCHOOL .  23 

2ND  YEAR  OF  VOCATIONAL, 

BUSINESS  OR  TRADE  SCHOOL . 24 

MORE  THAN  2  YEARS  VOCATIONAL, 

BUSINESS  OR  TRADE  SCHOOL  .  25 

«  REFUSED  .  -7 

DON'T  KNOW  .  -8 


Is  your  aother  now... 

working  full-tiae,  .  1 

working  parr-tine .  2 

unemployed .  3 

retired,  or  .  4 

taking  care  of  a  family 

at  home,  or  .  5 

in  the  military?  .  6 

DECEASED  .  7 

OTHER  .  8 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


CATI  CHECK  *DE1A:  DOES  RESPONDENT  LIVE  WITH  PARENTS? 

[DE-14  -  1]  OR  (DE-14  -  OK  OR  REFUSED] 
AND  DE-19  -  DK  OR  REF  AND 
DE-26  -  DK  OR  REF 

YES  .  1  ( DE-36) 

_ NO  .  2 _ fDE-171 _ 
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what  relationship  to  you  is  the  head  of  household  in  the  house 
apartment  you  are  living  in? 


BROTHER 

SISTER  . 

UNCLE  . 

AUNT  . 

GRANDFATHER 
GRANDMOTHER 
COUSIN  . 


(DE-19A) 

(DE-19A) 

(DE-19A, 

(DE-19A) 

(DE-19A) 

(DE-19A) 

(DE-19A) 


SPOUSE  .  8  (DE-19A) 


NON- RELATIVE 


(DE-19A) 


RESPONDENT  .  10  (DE-36) 


OTHER  _ 
REFUSED 


91  (DE-18 ) 
—7  ( DE-19A) 


DON'T  KNOW  . .  -8  (DE-19A) 


0E-19A.  What  was  the  highest  grade  or  level  of  education  that  'PERSON 
DE-17)  completed? 

LESS  THAN  3TH  GRADE  .  07 

STH  GRADE  .  08 

9TH  GRADE  .  09 

10TH  GRADE  .  10 

11TH  GRADE  .  11 

12TH  GRADE  .  12 

1ST  YEAR  Or  4-YEAR  COLLEGE  .  13 

2ND  YEAR  or  4-YEAR  COLLEGE  .  14 

3RD  YEAR  OF  4 -YEAR  COLLEGE  .  15 

4TH  YEAR  OF  4-YEAR  COLLZGE  .  16 

STH  YEAR  COLLEGE/ 1ST  YEAR 
GRADUATE  OR  PROFESSIONAL  SCHOOL  ....  17 
2ND  YEAR  GRADUATE  OR 

PROFESSIONAL  SCHOOL .  18 

3RD  YEAR  GRADUATE  OR 

PROFESSIONAL  SCHOOL  .  19 

MORE  THAN  3  YEARS  GRADUATE/ 

PROFESSIONAL  SCHOOL  .  20 

1ST  YEAR  OF  JR.  OR  COMMUNITY 

COLLEGE  .  21 

2ND  YEAR  OF  JR.  OR  COMMUNITY 

COLLEGE  .  22 

1ST  YEAR  OF  VOCATIONAL, 

BUSINESS  OR  TRADE  SCHOOL .  23 

2ND  YEAR  Or  VOCATIONAL, 

BUSINESS  OR  TRADE  SCHOOL  .  24 

MORE  THAN  2  YEARS  VOCATIONAL, 

BUSINESS  OR  TRADE  SCHOOL .  25 

REFUSED  .  -7 

DON’T  KNOW  .  -8 
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3E-36.  Did  you  ever  participate  in  a  Reserve  Officer's  Training 
<ROTC)  course? 

YES  .  1  (DE-37) 

HO  .  2  (DE-39) 

REFUSED  .  -7  r DE-39) 

DON'T  KNOW  .  -3  (DE-39) 


was  that  Junior  ROTC  in  high  school  or  Senior  ROTC  in  :ol 

JUNIOR  (IN  HIGH  SCHOOL)  .  1  (DE-39) 

SENIOR  (IN  COLLEGE)  .  2  (DE-38) 

REFUSED  .  -7  (DE-39) 


DON'T  KNOW 


-7  (DE-39) 

-8  (DE-39) 


3E-33.  was  that  Army  ROTC,  Air  Force  ROTC  or  Navy  ROTC? 


ARMY  . 

AIR  FORCE 

NAVY  . 

REFUSED  . . 


DON'T  KNOW  .  -8 


3E-39.  What  is  the  name  of  the  county  in  which  you  live? 


REFUSED  . . . 
DON'T  KNOW 


3E-40.  what  is  the  name  of  the  city  in  which  you  live? 


REFUSED  .  -7 

DON'T  KNOW  .  -8 


3E-4I.  what  is  your  dip  code? 


REFUSED  .  -7 

DON'T  KNOW  .  -8 


-.V.V.VJ 
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.  New  I  need  to  racord  your  Social  Security  Number.  we  are 
for  this  number  for  use  in  another  study  to  determine  if 
ideas  we  have  been  discussing  are  related  to  whether  or 
someone  enlists  in  a  military  service. 

Let  me  remind  you  that  your  answers  are  voluntary  and  wil 
completely  confidential.  Under  no  circumstances  will  you 
identity  be  made  Know  to  anyone  in  the  military. 


DOES  NOT  HAVE  SSN 

REFUSED  . 

DON’T  KNOW  . 


0 


-7 

-8 


f 

I 

, 


CAT I'  CHECX  *DE2:  IS  YOUTH  SELECTED  FOR  POTENTIAL 

INCLUSION  IN  LONGITUDINAL  COMPONENT? 

YES  ....  1  (TRACKING  MODULE) 

NO  .  2  (CATI  CHECK  *DE3) 


#DE3:  IS  PARENT  OF  YOUTH  TO  BE  SELECTED 

FOR  PARTICIPATION  IN  THE  INFL'JENCER 
SAMPLE? 

YES  ....  1  (PARENTAL  LOCATION  MODULE) 
„„  ...  2  f - * - 


imm; 


i.  ( > 
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we  would  like  to  interview  your  (PARENT)  regarding  (his/her: 
thoughts  about  future  plans  and  possibilities  for  you.  Please 
-give  ae  (his/her)'  naae  and  telephone  nuaber. 

(NAME) 

area'  exchange  Local' 

Think  now  about  the  possibility  of  joining  the  Araed  Services  : 
the  future.  How  iaportant  is  your  (PARENT)  '  s  advice  in  your 
decision  about  serving  in  the  ailitary.  Is  it... 

very  iaportant,  .  1 

soaewhat  iaportant .  2 

neither  iaportant  nor  uniaportant, . .  3 

soaewhat  uniaportant,  or .  4 

very  uniaportant?  .  5 

REFUSED  .  -7 

DON'T  KNOW  . -8 


ERMINATION 


iicms  :  : 
:  :JB  :  r 
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INTRODUCTION:  It  is  possible  that  we  will  call  again  scmetme 

the  future  to  obtain  some  updated  information  from  you.  I'd 
to  ask  you  a  few  questions  that  will  help  us  to  recontact  you  : 
a  later  date. 


In  vnac  name  is  this  phone  number  (AREA  CODE  4  NUMBER) 


NOT  LISTED  .  Q 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


If  we  were  to  recontact  you  one  year  from  now,  do  you  expec 
we  could  reach  you  at  this  same  telephone  number? 


YES  . 

NO  . 

REFUSED  .  .  . 
DON’T  KNOW 


Why  is  that? 


1  (TR-9) 

2  (TR-3) 
-7  (TR-9) 
-8  (TR-9) 


MOVING  .  1  (TR-4) 

NUMBER  BEING  CHANGED  .  2  (TR-6) 

OTHER (SPECIFY)  .  91  (TR-9) 

REFUSED  .  -7  (TR-9) 

DON’T  KNOW  .  -8  (TR-9) 


when  do  you  expect  to  be  moving? 


(HM/YY) 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


To  what  address  will  you  be  moving? 

STREET:  _ 


STATE:  _ 

ZIP:  _ 

REFUSED  .  -7  (TR-7) 

DON’T  KNOW  .  -8  (TR-7) 


ft 


a» 
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:c  (» 

LO  (  ) 


is 


. .  W  'AVWV.V.'  ^BVWJV^VjyA^’JWlVJW^V.^;  w' w  v.-.*.-.r 


y.S:  PARENT  IUESTIONNAIRE  (October  13,  1986)  PARENTAL  INFLUENCEKS 
»  ;*::-007?  expiration  31  August,  1989  pg .  1-1 

INTRODUCTION:  I  would  like  to  ask  you  a  few  questions  as  the 

„  father/ aether)  of  (YOUTH'S  NAME),  about  talks  you  aay  have  -.ad 
with  (his/her)  about  (his/her)  educational  and  job  plans.  By 
talks,  we  aean  any  kind  of  informal  talking  you  and  (YOUTH'S 
NAME)  say  have  done  concerning  what  (he/she)  plans  to  do  aocut 
education,  jobs,  or  job  preparation. 

PI-2.  How  often  have  you  had  such  discussions  in  the  last  12  ncr.t.-.s? 
was  it. . . 


never,  .  1  (PI-6) 

rarely .  2  (PI-5) 

occasionally,  or  .  3  (PI-5) 

often?  .  *  (PI-5) 

REFUSED  .  -?  (PI-5) 

DON'T  KNOW  . -8  (PI-5) 


PI-5.  During  these  talks,  do  you  typically  give  your  opinions  or  ds 
try  to  stay  neutral? 


GIVE  OPINION  .  1 

TRY  TO  STAY  NEUTRAL .  2 

REFUSED  .  -7 

DON 1 T  KNOW  .  -8 


PI -5.  How  such  influence  do  you  think  you  have  had  on  (YOUTH’S  NAME , 
plans  for  the  future?  Have  you  had: 


a  great  deal  of  influence .  1 

a  considerable  amount  of 

influence .  2 

soae  influence .  3 

very  little  influence,  or  .  * 

no  influence  at  all?  .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


? ; - 7 .  what  would  you  like  to  see  (YOUTH'S  NAME)  do  in  the  future? 
would  you  like  (his/her)  to: 


Go  to  college,  .  1 

Get  training  in  a  vocational 

or  technical  program,  .  2 

Get  a  full-tine  job,  .  3 

Join  the  Armed  Services,  .  ♦ 

Get  aarried  and  not  work,  or  ... •  5 

Something  else?  (SPECIFY) _  ..  91 

REFUSED  . -7 

DON'T  KNOW  .  -8 


4 
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A 
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PI-3.  For  tost  young  Men .  do  you  think  service  in  the  Military  is.. 

Definitely  a  good  idea,  .  1 

Probably  a  good  idea .  2 

Probably  not  a  good  idea,  or .  3 

Definitely  not  a  good  idea?  .  4 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


PI-9.  For  sost  young  women,  do  you  think  service  in  the  military  .s 


Definitely  a  good  idea,  .  1 

Probably  a  good  idea,  .  2 

Probably  not  a  good  idea,  or  . . . .  3 

Definitely  not  a  good  idea?  .  4 

REFUSED  .  -7 

DON'T  KNOW  .  -3 


PI-10.  Have  you  talked  to  (YOUTH'S  NAME)  about  enlisting  m  one  Arte- 
Services? 


YES  . 

NO  . 

REFUSED  .. 
DON'T  KNOW 


1  (PI-11) 

2  (PI-18) 

-7  (PI-18) 

-8  (PI-18) 


PI -11.  How  often  have  you  talked  about  this? 


NEVER  . 

RARELY  . 

OCCASIONALLY 

OFTEN  . 

REFUSED  .... 
DON'T  KNOW  . 


1  (PI-18) 

2  (PI-18) 

3  (PI-14) 

4  (PI-14) 

7  (PI-14) 

3  (PI-14) 


PI-14.  Were  these  talks  about  entering  as  an  officer,  as  an  enlisted 
person,  or  both? 


ENLISTED  .  1 

OFFICER  .  2 

BOTH  .  . .  3 

NEITHER  .  4 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


PI-15,  whicn  services  have  you  talked  about?  (CODE  ALL  THAT  apply; 


YES  U2  EK  REF 


ARMY  .  1  2  -7  -8 

NAVY  .  1  2  -7  -8 

AIR  FORCE  .  1  2  -7  -8 

MARINE  CORPS  .  1  2  -7  -8 

ALL  SERVICES  IN  GENERAL  .  1  2  -7  -3 


iW|VAti 
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Have  you  talked  about  ( YOUTH ' S  NAME)  signing  up  for  active  i 
lor  the  Reserve,  or  for  the  Matronal  Guard?  (PROBES:  The 
Reserve  are  people  in  all  services  who  train  once  a  wee*,  or 
weekend  a  month  and  a  couple  of  weeks  in  the  summer .  The 
National  Guard  consists  of  Army  and  Air  Force  umt3  wnicn  i: 
under  the  control  of  the  governor  of  the  state;  they  also  tr 
;ust  once  a  week,  or  one  weekend  a  month,  and  a  couDle  of  we 
in  the  summer.)  (CODE  ALL  THAT  APPLY) 


ACTIVE  DUTY  . . . 

RESERVE  . 

NATIONAL  GUARD 


YES  QJS  2£I 

1  2-7  -8 

1  2-7  -8 

l  2-7  -a 


When  you  talk  about  military  service,  do  you  generally  er.ccur  3 re  . 
discourage,  or  stay  neutral  about  (YOUTH'S  SAME)  enlisting' 


ENCOURAGE  . . . 
STAY  NEUTRAL 
DISCOURAGE  . . 

REFUSED  . 

DON ’ T  KNOW  . . 


PI-13.  How  much  influence  do  you  think  you  have  had  on  (YOUTH'S  :.'AH 
plans  about  enlisting?  Nave  you  had: 

a  great  deel  of  influence,  .  l 

a  considerable  amount  of 

influence .  2 

some  influence .  3 

very  little  influence,  ;r  .  « 

no  influence  at  all?  .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -8 

PI-19.  Have  you  pointed  out  ads  for  the  services  in  the  mass  media? 

YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 

PI-21.  Have  you  talked  to  your  (son/daughter)  about  seeing  a  milita 
recruiter? 

YES  .  1  (PI-22) 

NO  .  2  (PI-23) 

REFUSED  .  -7  (PI-23) 

DON'T  KNOW  .  -8  (PI-23) 
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-Save  you  dona  this  for  the  .... 


Arty?  . 

Navy?  . . . .  , 
Air  Force? 
Marinas?  . 


rlave  you  recaivad  ailitary  recruiting  aaterials  sailed 
l YOUTH'S  NAME)  at  your  home  address? 

YES  .  1  (PI-24) 

NO  .  2  (PI-25) 

REFUSED  .  -7  (PI-25) 

DON'T  KNOW  .  -3  (PI-25) 


How  likely  is  it  that  (YOUTH'S  NAME)  will  enlist  in  the  silica: 
in  the  next  few  years?  Would  you  say  that  (he/ she) . . 


definitely  will  .  1 

probably  will  .  2 

probably  will  not,  or  .  3 

definitely  will  not  .  4 

REFUSED  .  -7 

DON'T  KNOW .  -8 


(PI-26) 

(PI-25) 

(IMPORTANCE  MODULE. 
(IMPORTANCE  MODULE 
(IMPORTANCE  MODULE, 
(IMPORTANCE  MODULE, 


Do  you  expect  that  (YOUTH'S  NAME)  will  enter  the  ailitary  as  a: 
enlisted  person  or  as  an  officer? 

ENLISTED  PERSON  .  1 

OFFICER  .  2 

REFUSED  .  -7 

DON'T  XNOW  .  -3 


(GO  TO  IMPORTANCE  OF  ATTRIBUTES  MODULE] 
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I.A-2.  In  thinking  about  (YOUTH'S  NAME ) 1 s  future,  how  important  is  -t  t: 
you  that  (he/she)  have  opportunities  for  the  following  things' 

Use  a  seal*  of  1  to  5  where  a  *1"  means  it  is  not  at  all 
important  and  "5"  means  it  is  vary  important. 

NOT  VERY 

IMP  IMP  PEE  ii 

a.  Having  a  physical  challenge  .  1  2  3  4  5  -*  -5 

b.  Working  with 

highly  trained  people  .  1  2  3  4  5  -7  -3 

z .  Earning  money  for  college 

or  vocational  school  .  1  2  3  4  5 

d.  Training  in  useful  skill  areas  ..1  2  3  4  3  -7  -3 

a.  Developing  self-confidence  .  1  3  3  4  5  -7  - 

f%  Serving  (his/her)  country  .  1  2  3  4  5  -3 

g.  Developing  leadership  skills  ....  1  2  3  4  5  -3 

h.  Working  with  the  latest 

high  tech  equipment  .  1  2  3  4  5  -3 

1.  Having  experiences  (he/ she) 

can  be  proud  of  .  1  2  3  4  5  -*  -3 

j .  Developing  (his/her)  potential  ..  1  2  3  4  5 

k.  Helping  (his/her) 

career  development  .  1  2  3  4  5  -7  -3 

l.  Serving  (his/her)  own  community?.  12345-7-3 

m.  Having  weekend  excitement  .  1  2  3  4  5  -3 

n.  Staying  in  (his/her)  own 

hometown  .  1  2  3  4  5  -*  -3 

o.  Having  a  stepping  atone 

between  high  school 

and  college  .  1  2  3  4  5  -7  -3 

p.  Becoming  more  mature  and 

responsible  .  1  2  3  4  5  -7  -3 

q.  The  opportunity  to  make  changes 

and  use  (his/her)  own  judgement.  1  2  3  4  5  -3 

r.  Having  a  mental  challenge  .  1  2  3  4  5 


(SKIP  TO  MEDIA  HABITS  MODULE] 


8-91 


X  C  J 


!l 
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MK-l.  Co  you  regularly  watch  TV? 

YES  .  1  (MH-2 ) 

NO  .  2  (MH-14) 

REFUSED  .  -7  {MH-2 ) 

DON'T  KNOW  .  -8  (MH-2) 


MH-2.  How  sany  hours  par  week  do  you  spand  watching., 


b.  Programs  on  commarcial  networks 
such  as  ABC,  CSS,  or  NBC? 


a.  Programs  on  commarcial  cabla 
stations  such  as  ESPN,  MTV, 
USA,  or  TBS? 


*  HOURS 


i  HOURS 


CATI  CHECK  *MH1:  IS  CABLE  OR  SUBSCRIPTION  TV  WATCHED? 
[MH-2b  >  0] 

YES  .  1  (MH-11) 


MH-11.  Do  you  watch  any  of  tha  following  Cahla  or  Subscription  TV 
channals  regularly? 


MTV?  . 

Nashville  Network  [TNN] ? 

ESPN  [Sports]? 

WTBS  [Syndicated]? 

Black  Entertainment  TV  [BET]? 


MU-12.  Do  you  frequently  watch  any  of  tha  following  types  of  tv  shows’ 


Sports?  . 

YES 

1 

32 

2 

REF 

-7 

Q£ 

-8 

Suspense  or  mystery?  . . 

1 

2 

-7 

-8 

General  drama?  . 

1 

2 

-7 

-8 

Music  or  music  video?  • 

1 

2 

-7 

-8 

Situation  comedy?  . 

1 

2 

-7 

-8 

TV  movies?  . 

1 

2 

-7 

-8 

Talk  shows?  . 

1 

2 

-7 

-8 
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MH -13.  Pleasa  tall  ae  if  you  watch  any  of  tha  following  tv  show 


David  Letteraan? 

YES 

1 

(£2 

2 

REF 
-  7 

-  V 

-3 

Friday  Night  videos? 

1 

2 

-7 

-3 

Monday  Night  Football? 

College  Football? 

1 

2 

-7 

-3 

1 

2 

-7 

-3 

Sunday  Night  at  tha  Mov*es? 

1 

2 

-7 

-3 

MH-14.  Doas  your  household  hava  a  Vidao  Cassatta  Racorder  (VCR) ? 

YES  .  1  (MH-15) 

NO  .  2  (MH-16) 

REFUSED  .  -7  (MH-16) 

.  DON'T  KNOW  .  -8  (MH-16) 

MH-15.  How  aany  hours  par  week  do  you  usually  spend  watching  you 

*  HOURS 


MH-16.  Now  let's  talk  about  radio  listening.  Do  you  regularly  1 
tha  radio? 

YES  .  1  (MH-17 ) 

NO  .  2  (MH-28) 

REFUSED  .  -7  (MH-28) 

DON'T  KNOW  .  -8  (MH-28) 


MH-1"’.  How  aany  hours  par  wee*  do  you  listen  to  .. 

a.  AM  Radio?  _ 


b.  FM  Radio? 


*  HOURS 


♦  HOURS 


MH-26.  Do  you  frequently  listen  to  any  of  tha  following  types  of 
programs? 


News?  . 

Classical  ausic?  . 

Pop?  . 

country?  . 

Sports?  . 

Talk  Shows?  . 

Rock  &  Roll?  . 

"Easy  Listening"? 


YES  5J2  S£l 
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MH-2'.  Do  you  listan  to  tha  following  programs? 

IE£  MS  SEE  2E 

Amarican  Top  40?  1  2-7-8 

King  Biscuit  Flowar  Hour?  1  2-7-8 

RicJt  Daas 1  Top  40?  1  2-7-3 

Matalshop?  1  2-7-3 

RocJdina?  1  2-7-3 

MH-23.  How  oftan  do  you  raad  tha  nawspapar?  Is  it... 

navar,  .  1  (MH-31) 

lass  than  tvica  a  waaic .  2  (MH-29) 

2-3  timas  par  waaic,  .  3  (MH-29) 

*  4-5  timas  par  waa)e,  or .  4  (MH-29) 

daily?  .  5  (MH-29) 

REFUSED  .  -7  (MH-31) 

DON'T  KNOW  .  -8  (MH-31) 


MH-29.  How  many  hours  do  you  spand  raading  tha  nawspapar  aach  ween? 
>  HOURS 


MH-30.  DO  you  ragularly  raad  any  of  tha  following  saetions? 


SpOftJ?  aeesaaaaseaee*. 

YES 

MS 

2 

a EC 

-7 

2K 

-8 

Comics?  . . 

2 

-7 

-3 

?  ••••••••••••«•■• 

2 

-7 

-8 

*••#••••••••••• 

2 

-7 

-3 

Food?  •••••••••••••••• 

2 

-7 

-3 

Lifastyla?  . 

2 

-7 

-3 

CLassifiad?  . 

2 

-7 

-3 

MH-31.  Finally,  I  would  lifca  to  discuss  magazina  raadarship.  Do  you 
regularly  raad  magazinas? 


TES  .  I  (KH-32) 

NO  .  2  (RECALL  MODULE) 

REFUSED  .  -7  (RECALL  MODULE) 

DON'T  KNOW  .  -8  (RECALL  MODULE) 
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MH-3L.  what  magazines  do  you  raad  on  a  ragular  basis,  that  is,  t.-.cs? 
that  you  hava  raad  at  least  3  of  the  past  4  issues? 


REFUSED  . . . 
DON'T  KNOW 


MH-33.  About  how  many  hours  a  vaeic  do  you  spend  reading  aagazi-es ■ 


*  HOURS 


[GO  TO  KNOWLEDGE- RECALL,  MODULE! 


g! 

Si 


1 

R A 

| 

§f 
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Now,  thinking  about  TV,  radio,  newspapers,  aagaiines,  and  any 
other  sourcas  of  advartiaing,  for  what  Military  sarvica  or 
aarvicaa  do  you  racall  aaaing  or  haaring  any  advertising? 
(PROSE:  Any  othar  aarvicaa?) 

'RECORD  ALL  THAT  APPLY. ] 


NONE  . 

...  0 

(KR-5) 

AIR  FORCE . 

...  1 

(CATI 

CHECK 

4KR5, 

ARMY  . 

RESERVE  OFFICER' S  TRAINING 

...  2 

(CATI 

CHECK 

4KR6  i 

CORPS,  or  R.O.T.C . 

...  3 

(CATI 

CHECK 

♦  KRl; 

NATIONAL  GUARD  . 

...  4 

(CATI 

CHECX 

♦  KR2) 

RESERVE  . 

...  5 

(CATI 

CHECX 

4KR3  j 

COAST  GUARD  . 

,  ,  ,  $ 

(CATI 

CHECX 

4KR10) 

MARINE  CORPS  . 

...  7 

(CATI 

CHECX 

♦KR1I, 

MAVY  . 

(CATI 

(CATI 

CHECK 

CHECX 

4KR12 , 
»KR4  , 

ONE  AO  FOR  ALL  SERVICES  . 

...  9 

REFUSED  . 

...  -7 

(KR-5) 

(KR-5) 

DON'T  KNOW  . 

...  *  8 

CATI  CHECX  4KR1 :  WAS  R.O.T.C.  MENTIONED? 
[KR-1  -  3] 


YES  .  1  (KR-2) 

NO  .  2  (CATI  CHECX  IXR2) 


You  Mentioned  aaaing  or  haaring  advartiaing  for  tha  Raaarve 
Officar'a  Training  Corps.  For  which  Military  sarvica  or  set-/ 
was  this  advartiaing?  (RECORD  ALL  THAT  APPLY] 


AIR  FORCE  .  1 

ARMY  .  2 

NAVY . . .  3 

MARINE  CORPS  .  4 

COAST  GUARD  .  5 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


'CATI  CHECX  *KR 2:  WAS  NATIONAL  GUARD  MENTIONED? 


la 


•I. 
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You  aentioned  seeing  or  hearing  advertising  for  the  National 
Guard.  For  which  aiiitary  service  or  services  was  this 
advertising?  [RECORD  ALL  THAT  APPLY] 

AIR  FORCE  .  1 

ARMY  .  2 

NAVY  .  3 

MARINE  CORPS  .  4 

COAST  GUARD  .  5 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


WAS  RESERVE  MENTIONED? 

[ KR-1  -  5] 

YES  .  1  (KR-4) 


You  aentioned  seeing  or  hearing  advertising  for  the  Sese 
which  aiiitary  service  or  services  was  this  advertising? 
ALL  THAT  APPLY] 

AIR  FORCE  .  1 

ARMY  .  2 

NAVY  .  3 

MARINE  CORPS  .  4 

COAST  GUARD  .  5 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


CATI  CHECK  4KR4:  OID  RESPONDENT  RECALL  SJmL  INDIVIDUAL 
ADS  ONE  AD  FOR  ALL  SERVICES? 

[KR-1  *  1  THROUGH  9 

YES  .  1  (KR-14) 

NO  .  2  (CATI  CHECK  *KR5) 

♦  KR5 :  DID  RESPONDENT  RECALL  SEEING  OR  HEARING 
AN  AD  FOR  THE  AIR  FORCE? 

[KR-1  -  1] 

YES  .  1  (CATI  CHECK  4KR6) 


IRion 


Do  you  recall  seeing  or  hearing  any  advertising  for  the  Air 
Force? 

YES  .  1 

NO  .  2 

REFUSED  .  -7 

OON’T  KNOW  .  -8 


■'V-VW’.  v v.Av.v.  /.  j*  „•  .•  w.  v . 


to  o 


MS:  PARENT  QUESTIONNAIRE  (October  13.  198S)  MODULE:  KNOWLEDGE- RE CAL 
*  3702-0077  expiration  31  August,  1989  pg.  -*-3 


:CATI  CHECX  *KR6:  DID  RESPONDENT  RECALL  SEEING  OR  HEARING 
AN  AD  FOR  THE  ARMY? 
i  [KR-1  -  2] 

[ 

YES  .  1  (CATI  CHECK  #KR7) 

I _ SO  .  ■  ■  . .  2 _ LKR-5) _ 


KR-6.  ( Do  you  recall  seeing  or  hssring  any  advertising  for]  The  Aray' 


TES  .  1 

NO  . 2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


CATI  CHECX  *KR 7:  DID  RESPONDENT  RECALL  SEEING  OR  HEARING 
AN  AD  FOR  THE  ARMY  R.O.T.C.? 

CKR-2  -  2} 


YES  .  1  (CATI  CHECK  *KR8) 

re  ...........  2 _ lkblu _ 


KR-7.  (Do  you  recall  seeing  or  beering  any  advertising  for’  The  Arav 
Reserve  officer's  Training  Corps,  that  is,  the  Aray  R.o.T.C? 


YES  .  1 

NO  .  2 

REFUSED  .  -7 

OON'T  KNOW  .  -8 


CATI  CHECK  *KRS:  DID  RESPONDENT  RECALL  SEEING  OR  HEARING 
AN  AD  FOR  THE  ARMY  NATIONAL  GUARD? 

(XR-3  -  2] 


YES  .  1  (CATI  CHECK  #KR9) 

NO  .  2  i  KR— 8 1 


KR-a.  (Do  you  recall  seeing  or  hearing  any  advertising  for]  The  Arav 
National  Guard? 


YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


UJ  o 
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CATI  CHECK  45Q19 :  DID  RESPONDENT  RECALL  SEEING  OR  HEARING 
i  AN  AD  FOR  THE  ARMY  RESERVE? 

[KR-4  -  2] 

YES  .  1  (CATI  CHECK  4KR10) 

_ ,  L..U,  2 _ USBzii _ 

:<R-9 .  (Do  you  recall  seeing  or  hearing  any  advertising  for]  The  Arty 

Reserve? 


YES  . 

NO  . 

REFUSED  . . . 
DON'T  KNOW 


CATI  CHECX  *KR10:  DID  RESPONDENT  RECALL  SEEING  OR  HEARING 
AN  AD  FOR  THE  COAST  GUARD? 

( KR-1  -  6] 

YES  .  1  (CATI  CHECX  4KR11) 

_ NO  .  2 _ fXR-10)  _ 


XR-IO.  (Do  you  recall  seeing  or  hearing  any  advertising  for]  The  Coast 
Guard? 


YES  . 

NO  . 

REFUSED  . . . 
DON'T  KNOW 


CATI  CHECK  4KR11:  OID  RESPONDENT  RECALL  SEEING  OR  HEARING 
AN  AD  FOR  THE  MARINE  CORPS? 

(KR-i  "  ?  3 

YES  .  1  (CATI  CHECX  4KR12) 


KR-11.  (Do  you  recall  seeing  or  hearing  any  advertising  for]  The  Marine 
Corps? 

YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON'T  KNOW  .  -8 
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YES  2£2 


Did  you  see  or  hear  Aray  ads... 


On  TV?  . 

On  the  radio?  . 

In  magazines?  . 

In  newspapers?  . 

On  billboards?  . 

Through  the  mail?  . 

On  posters?  . 

In  brochures  or  pamphlet s? 

In  the  Yellow  Pages?  . 

Somewhere  else?  . 


OATI  CHECK  ♦KRIS:  DIO  RESPONDENT  RECALL  SEEING  OR  HEARING 
AN  ARMY  AD  (UNAIDED  OR  AIDED)? 

(KR-1  -  2  OR  KR-6  -  1] 

YES  .  1  (KR-15) 

NO  .  2  (  CAT?  CHECK  ilfS  ’41 


KR-15.  Other  than  trying  to  get  you  to  enlist,  what  was  the  main  aessac 
you  got  from  Aray  advertising? 


CATI  CHECK  4KR16:  DIO  RESPONDENT  RECALL  ANY  ADS  OTHER 
THAN  THE  ARMY  AD? 

[KR-1  -1,  3,  4,  5,  6,  7,  8  OR  9]  OR 
[KR-5,  OR  KR-7,  OR  KR-8 ,  OR  KR-9 ,  OR  KR-13, 
OR  KR-11,  OR  KR-12,  OR  KR-13  -  1] 

YES  .  1  (CATI  CHECK  ♦KR17) 

NO  .  2  (ATTITUDES  MODULE) 


♦KR17:  RANDOMLY  SELECT  SERVICE  OR  SERVICE 

COMPONENT  OR  JOINT  SERVICES  AD  PROM  THOSE 


KR-17.  other  than  trying  to  get  you  to  enlist,  what  was  the  main  messace 
you  got  from  (SERVICE/SERVICE  COMPONENT)  advertising? 
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[GO  TO  ATTITUDES  MODULE] 


W3 
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I  am  going  to  read  you  a  list  of  statements  describing  diff 
tilings  th«  Army  might  offer.  Please  tell  me  how  much  you 
disagree  or  agree  that  the  Army  offers  each  item  on  the  I  is 
"1"  means  you  disagree  completely,  a  "2"  means  you  disagree 
somewhat,  a  "3"  means  you  neither  agree  nor  disagree,  a  "4" 
you  agree  somewhat  and  a  "5"  means  you  agree  completely. 


The  Army  offers... 

A.  a  wide  variety 

of  opportunities  to  find  a 
job  you  can  enjoy? 

3!  a  physically  challenging 
environment? 

C.  an  experience  you  can  be  proud  of? 

0.  an  advantage  over  going 

right  from  high  school  to  college? 

E.  an  opportunity 

to  develop  leadership  skills? 

F.  the  chance  to 

work  with  the  latest 
high  tech  equipment? 

<3.  a  great  value  in  your 

civilian  career  development? 

H.  an  excellent  opportunity  to 

develop  self-confidence? 

I .  the  opportunity  to 

develop  your  potential? 

J.  a  mentally  challenging 

experience? 

K .  an  opportunity  for  you  to  become 

more  mature  and  responsible? 

L.  many  opportunities  for  training  in 

useful  skill  areas? 

M.  many  chances  to  work  with  highly 

trained  people? 

M •  an  excellent  opportunity  to  obtain 

money  for  a  college  or  vocational 
education? 


PARENT 

■  ::-oot 
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CHECK  *PE2:  RANDOMLY  SELECT  A  CAREER  OPTION  FROM 
ARMY  RESERVE,  ARMY  NATIONAL  GUARD, 
AIR  FORCE,  NAVY,  MARINE  CORPS,  GOING 
TO  COLLEGE,  WORKING  IN  A  FULL-TIME 
CIVILIAN  JOB,  ALL  SERVICES. 

* PE3  :  'WHICH  CAREER  OPTION  WAS  SELECTED? 

ARMY  RESERVE  .  1  (PE-1A) 

ARMY  NATIONAL  GUARD  .  2  (PE-4 A) 

AIR  FORCE  .  3  (PE-3) 

NAVY  .  4  (PE-6) 

MARINE  CORPS  .  5  (PE-6) 

ALL  SERVICES  .  6  (PE-6) 

WORXING  IN  A  FULL-TIM- 

CIVILIAN  JOB  .  7  (PE-7) 

_ 2niN5LTO._COLLEGE  . .  3  'PE-3  1 


i.  Have  you  aver  heard  of  the  United  States  Army  Reserve? 


YES  . 

NO  . 

REFUSED  . .  . 
DON'T  KNOW 


.  1  (PE-4) 

; pe-4A) 
(PE-4A) 
-8  (PE-4) 


Knwrv'K.’rni  A’Tx.yk.vA'txn  M3t.TiLT,i-Tu  rw.'r^T-,  **  vy  wn  itsf 


ACC. MS : 
:«s  s 
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Now,  I  am  going  to  read  you  a  list  of  things  the  United  states 
Army  Reserve  sight  offer.  Please  tell  se  bow  such  you  dtsa 
or  agree  that  the  United  States  Army  Reserve  offers  each  it 
the  list.  Again,  a  "1"  aeans  you  disagree  completely,  a  "1" 
aeans  you  disagree  somewhat,  a  "3"  aeans  you  neither  agree  -cr 
disagree,  a  "4"  aeans  you  agree  somewhat  and  a  "5"  aeans  /c: 
agree  completely. 

The  United  States  Aray  Reserve  offers: 


A.  a  wide  variety  of  opportunities 

to  find  a  job  you  can  enjoy? 

B.  an  experience  you  can  be  proud  of? 

C.  an  opportunity  to  develop 

leadership  skills? 

□.  a  great  value  in  your  civilian  career 
development? 

E.  an  excellent  opportunity  to  develop 

self-confidence? 

F.  the  opportunity  to  develop  your 

potential? 

G.  a  mentally  challenging  experience? 

H.  the  opportunity  to  become  more 

mature  and  responsible? 

I.  many  opportunities  for  training  in 

useful  skill  areas? 

J.  many  chances  to  work  highly  trained 

people? 

K.  an  excellent  opportunity  to  obtain 

money  for  a  college  or  vocational 
education? 

L.  an  opportunity  to  serve  America  while 

staying  in  your  own  home? 

M.  a  chance  to  serve  your  own 

community? 

N.  interesting  and  exciting 

weekends  ? 


[SKIP  TO  PE-12] 
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PE-iA.  Have  you  ever  beard  of  the  United  States  Amy  National  -,uard? 

YES  .  1  (PE-5) 

MO  .  2  (PE- 12) 

REFUSED  .  -7  (PE-6) 

DON’T  KNOW  ...  -3  (PE-12) 
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PE-5.  Now,  I  am  going  to  read  you  a  list  of  statements  describing 
different  tilings  the  United  States  Aray  National  Guard  might 
offer.  Please  tall  aa  how  such  you  disagrae  or  agree  that 
United  States  Aray  National  Guard  offers  each  itaa  on  the  list. 
Again,  a  "l"  aaans  you  disagrae  coapletely,  a  "2"  means  you 
disagree  somewhat,  a  "3*  means  you  neither  agree  nor  disagree, 
T  means  you  agree  somewhat  and  a  "5"  means  you  agree 
completely. 

The  Aray  National  Guard  offers: 


A.  a  vide  variety  of  opportunities 
to  find  a  job  you  can  enjoy? 

3.  an  experience  you  can  be 
proud  of? 


Q£  ^5  pe~  zz 

1  2  3  4  5  -~  -3 


1  2  3  4  5 


C.  an  opportunity  to  develop 
leadership  skills? 

0.  a  great  value  in  your  civilian 
career  development? 

E.  an  excellent  opportunity  to  develop 
self-confidence? 


1  2  3  4  5 

1  2  3  4  5 

1  2  3  4  5 


F.  the  opportunity  to  develop  your 
potential? 


12345-7-? 


G.  a  mentally  challenging  experience? 

H.  an  opportunity  to  becoee 

more  mature  and  responsible? 

I.  man-,  ipportunities  for  training  in 

useful  skill  areas? 


1  2  3  4  5  -7  -5 

l  2  3  4  5  -7  -5 


1  2  3  4  5  -*  -5 


J.  many  chances  to  work  with  highly 

trained  people? 

K.  an  excellent  opportunity  to  obtain 

money  for  a  college  or  vocational 
education? 


1  2  3  4  5  -'  -5 

12345-7-5 


L.  an  opportunity  to  serve  America 

while  staying  in  your  own  home? 

M.  a  chance  to  serve  your 

ovn  community? 

N.  gives  you  interesting  and  exciting 

weekends? 


12345-7-5 

1  2  3  4  5  -7  -5 


12345-7-3 


[SKIP  TO  PE-12] 
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I  an  going  to  read  you  a  list  of  statements  describing  differ? 
things  the  (SERVICE)  might  offer.  Please  tell  me  how  much  yc. 
disagree  or  agree  that  the  (SERVICE)  offers  item  on  the  list. 
Again,  a  "1"  means  you  disagree  completely,  a  "2”  means  you 
disagree  somewhat,  a  "3"  means  you  neither  agree  nor  disagree. 
" 4"  means  you  agree  somewhat  and  a  "5"  means  you  agree 
completely. 

The  (SERVICE)  offers: 


A.  a  wide  variety 

of  opportunities  to  find  a 
job  you  can  enjoy? 

3*.  a  physically  challenging 
environment? 

C.  an  experience  you  can  be 
proud  of? 

0.  an  advantage  over  going  right 
from  high  school  to  college? 

E.  an  opportunity  to  develop 

leadership  skills? 

F.  the  chance  to  work  with 

the  latest  high  tech  equipment? 

<3.  a  great  value  in  your  civilian 
career  development? 

H.  an  excellent  opportunity  to  develop 

self-conf idence? 

I.  the  opportunity  to  develop  your 

potential? 

J.  a  mentally  challenging  experience? 

K.  an  opportunity  to  became 

more  mature  and  responsible? 

L.  many  opportunities  for  training  in 

useful  skill  areas? 

M.  many  chances  to  work  with  highly 

trained  people? 

N.  an  excellent  opportunity  to  obtain 

money  for  a  college  or  vocational 
education? 

[SKIP  TO  PE-12] 
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I  an  going  to  read  you  a  list  of  statements  describing  different 
things  working  in  a  full-time  civilian  job  night  offer.  Please 
tell  me  how  such  you  disagree  or  agree  that  working  in  a  full¬ 
time  civilian  job  offers  each  item  on  the  list.  Again,  a  "1" 
means  you  disagree  completely,  a  "2"  seans  you  disagree  somewr.at . 
a  "0"  means  you  neither  agree  nor  disagree,  a  "4"  means  you  acres 
somewhat  and  a  "5"  means  you  agree  completely. 


Working  in  a  full-time  civilian  job  offers: 


A.  a  physically  challenging 

environment? 

B.  an  experience  you  can  be  proud  of? 

C.  an  advantage  over  going 

right  from  high  school  to  college? 

D.  an  opportunity 

to  develop  leadership  skills? 

E.  the  chance  to  work  with 

the  latest  high  tech 
equipment? 

T.  a  great  value  in  your 

civilian  career  development? 

S.  an  excellent  opportunity 

to  develop  self-confidence? 

H.  the  opportunity  to 

develop  your  potential? 

I.  a  mentally 

challenging  experience? 

J.  the  opportunity  to  become  more 

more  mature  and  responsible? 

K.  many  opportunities  for 

training  in  useful  skill  areas? 

L.  many  chances  to  work  with  highly 
trained  people? 

M.  an  excellent  opportunity  to 
obtain  money  for  a  college  or 
vocational  education? 


[SKIP  TO  PE-12] 
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PE-3.  I  am  going  to  read  you  a  list  of  statements  describing  d 1 : 
things  going  to  college  sight  offer.  Please  tell  ae  how 
disagree  or  agree  that  going  to  college  offers  each  item 
list.  Again,  a  "1"  means  you  disagree  completely,  a  "2" 
you  disagree  somewhat,  a  "3"  means  you  neither  agree  nor 
disagree,  a  "4"  means  you  agree  somewhat  and  a  "5"  means  : 
agree  completely. 

Going  to  college  offers... 


A.  an  experience  you  can  be 
proud  of? 

3.  an  opportunity  to  develop 
leadership  skills? 

C.  a  great  value  in  your  civilian  career 
development? 

3.  an  excellent  opportunity  to  develop 
self-confidence? 

E.  the  opportunity  to  develop  your 

potential? 

F.  a  mentally  challenging  experience? 

G.  the  opportunity  to  become 

more  mature  and  responsible? 

H.  many  chances  to  worJc  with  highly 

trained  people? 


?E-12 .  Of  the  people  who  joined  the  Army  in  the  last  year,  what 

proportion  do  you  think  are  high  school  diploma  graduates? 
you  say . . . 

less  than  one  quarter,  .  1 

about  one  quarter .  2 

about  one  half,  .  3 

about  three  quarters,  or  .  4 

almost  all?  .  5 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


■mm  wrm  misw  wt  'i*  'em  m&.  w  v  r  n.*  mw.  wt  «?  «j.  p  ip  ka  kmwm  w,  ?  v,  y  wnw.  w  ^  <■  ^  <■  ^  «.■  ? 
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PE-13.  Of  tbs  people  who  joined  tils  Aray  last  year,  what  proportion  ia 
you  think  would  score  in  the  upper  half  of  an  intelligence  test’ 
Is  it. . . 


all  of  thea .  1 

three  quarters  of  them,  .  2 

half  of  thea,  .  3 

one  quarter  of  thea,  or  .  4 

none  of  thea?  .  5 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


PE- 14.  Of  the  people  who  joined  the  Aray  in  the  last  year,  what 

proportion  do  you  think  will  get  a  college  diploaa  either  while 
they  are  in  the  Army  or  after  they  coaplete  their  Aray  service’ 
Would  you  say... 


less  than  one  quarter,  .  1 

about  one  quarter,  .  2 

about  one  half,  .  3 

about  three  quarters,  or  .  4 

alaost  all?  .  5 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


[)>/ 

i 


PE- 15.  Do  you  think  very  aany  young  (aen/voaen)  with  backgrounds  and 
plana  for  the  future  like  (YOUTH)  are  joining  the  Aray? 


YES  .  1 

NO  .  2 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


CAT I  CHECX  8 PEI:  IS  YOUTH  ROTC  POTENTIAL? 


YES  .  1  (PE-15A) 

NO  .  2  (KNOWLEDGE  AWARENESS 

_ MODULE) _ 


PE- ISA.  Have  you  ever  heard  of  the  Aray  Reserve  Officer’s  Training 
Corps  on  a  college  caapus? 


YES  .  1  (PE-2) 

NO  .  2  (KNOWLEDGE-AWARENESS 

MODULE) 

REFUSED  .  -7  (KNOWLEDGE- AWARENESS 

MODULE) 


DON’T  KNOW  ..  -8  (PE-2) 


B- 115 
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hUMS:  PARENT  QUESTIONNAIRE  (October  13,  1986)  MODULE:  PERCEPTIONS 
::4.3  =  :"32-00?7  expiration  31  August,  1989  pg.  7-13 


Next,  I  will  read  you  a  few  statements  describing  different 
tilings  that  the  Army  Reserve  Officer's  Training  Corps  on  the 
college  campus  might  offer.  Please  tell  me  how  much  you  disa^ 
or  agree  that  being  an  officer  offers  each  item  on  the  list. 
"1"  means  you  disagree  completely,  a  "2"  means  you  disagree 
somewhat,  a  "3"  means  you  neither  agree  nor  disagree,  a  "i"  -s 
you  agree  somewhat  and  a  "5"  means  you  agree  completely. 


The  Army  Reserve  Officer's  Training  Corps  on  the  college  rare, 
provides. . . 


A.  leadership  and 
.  management  training? 


1  2  3  4  3  -' 


3.  the  opportunity  to  develop 
self-confidence? 


1  2  3  4  5  -' 


C.  a  college  elective  that 

can  be  taken  together  with  other 
college  courses? 


12  3  4 


0.  an  officer's  commission 

in  the  active  Army,  Army  Reserve, 
or  the  Army  national  Guard? 


1  2  3  4  5 


Being  an  officer  in  the  United  States  Army  means  different  th 
to  different  people.  Please  tell  me  how  much  you  disagree 
agree  that  being  an  officer  offers  each  item  on  the  list, 
means  you  disagree  completely,  a  *2"  means  you  disagree  sosfe-. 


means  you  neither  agree  nor  disagree,  a 


means  you 


somewhat  and  a 


means  you  agree  completely. 


Being  an  officer  in  the  United  States  Army  provides.. 


a  wide  variety  of 
job  opportunities? 


experiences  you  can  be  proud  of? 


the  opportunity  to  use  your  college 
acquired  skills? 


the  opportunity  to  make  changes  and 
use  your  own  judgment? 


[GO  TO  KNOWLEDGE -AWARENESS  MOOULE] 
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:<A - ' .  Is  it  possible  to  earn  money  for  college  by  enlisting  in  tne 
Aray  ? 

YES  .  1  (KA-1) 

NO  .  2  (CATI  CHECK  * KA4 , 

REFUSED  .  -7  (KA-1) 

DON’T  KNOW  .  -8  (KA-1) 

KA-1.  How  auch  do  you  think  a  young  (aan/woaan)  can  earn  througn  A 
education  benefits  for  college? 

(PROBE:  This  would  be  the  total  education  benefits  that  ecu 
earned  while  in  the  Aray.] 

UNOER  35,000  .  1 

$5,000  TO  39,999  .  2 

310,000  TO  31* , 999  .  3 

315,000  TO  319,999  .  4 

320,000  TO  324,999  .  5 

S25.000  OR  MORE  .  6 

REFUSED  .  -7 

DON’T  KNOW  .  -8 

XA-2.  Oo  you  thinJc  Aray  education  benefits  would  pay  for  (YOUTH’S; 
entire  college  education? 


YES  . 

NO  . 

REFUSED  . ,  . 
DON’T  KNOW 


Do  you  think  Aray  education  benefits  are  aore,  less  or  about 
same  as  the  Navy,  Air  Force,  or  Marines  offer? 


MORE  . 

LESS  . 

ABOUT  THE  SAME 

REFUSED  . 

DON’T  KNOW  , . . . 


KA-4.  Please  tell  me  whether  or  not  each  of  the  following  services 
offers  the  "OI  Bill”? 


Aray  . 

Air  Force 

Navy  . 

Marines  . . 


DOES 

2ZES8 

l 

1 

l 

l 


DOES 
NOT 
<311 SB 
2 
2 
2 
2 
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KA-12.  What  is  tha  aaxiaua  amount  of  aonay  for  collaga  that  qualified 
paopla  who  join  tha  Army  Reserve  or  Army  national  Guard  can 
racaiva  undar  tha  "GX  Bill"? 

UNDER  $1,000  .  1 

$1,000  TO  $1,999  .  2 

$2,000  TO  $3,999  .  3 

$4,000  TO  $S , 999  .  4 

$6,000  TO  $7,999  .  5 

$3,000  TO  $9,999  .  6 

$10,000  OR  MORE  .  7 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


[GO  TO  DEMOGRAPHICS  MODULE] 
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INTRODUCTION:  Now  I  have  soma  questions  about  your  background . 


IE-1.  First,  what  is  your  birthdata? 


MONTH  DAY  YEAR 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


DE-3.  Please  tell  me  whether  you  consider  yourself... 

White,  .  1 

Black,  .  2 

*  Asian  or  Pacific  Islander,  or  .  3 

American  Indian,  Alaskan  Native?  ...  4 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


DE-4.  Are  you  of  Hispanic  background? 

[ INCLUDES  SPANISH- AMERICAN,  MEXICAN  AMERICAN,  CHICANO, 
AMERICAN] 


YES  . 

NO  . 

REFUSED  . . . 
DON'T  KNOW 


;  QUESTION  BANK  ITEM  DE-5  NOT  USED  IN  QUARTER  1] 


3E-6.  What  is  your  current  marital  status?  Are  you: 

Single,  . .  1 

Married .  2 

Separated .  3 

Divorced,  or  .  4 

Widowed?  .  5 

REFUSED  .  -7 

DON’T  KNOW  .  -8 


[QUESTION  BANK  IT  MS  DE-7,  DE-8  NOT  USED  IN  QUARTER  1] 
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DE--3.  what  is  the  highest  grade  or  year  of  school  or  college  that  ■ 
have  completed  and  gotten  credit  for? 

LESS  THAN  3TH  GRADE  .  07  (DE-11) 

8TH  GRADE  .  03  (DE-11) 

9TH  GRADE  .  09  (DE-11) 

10TH  GRADE  .  10  (DE-11) 

11TH  GRADE  .  11  (DE-11) 

12TH  GRADE  . .  12  (DE-10) 

1ST  YEAR  OF  4-YEAR  COLLEGE  (FR)  .  13  (DE-10) 

2ND  YEAR  OF  4-YEAR  COLLEGE  (SO)  .  14  (DE-10) 

3RD  YEAR  OF  4  YEAR  COLLEGE  (JR)  .  15  (DE-10) 

4TH  YEAR  OF  4  YEAR  COLLEGE  (SR)  .  16  (DE-10) 

5TH  YEAR  COLLEGE/ 1ST  YEAR 
GRADUATE  OR  PROFESSIONAL  SCHOOLS  ...  17  (DE-10) 

2ND  YEAR  GRADUATE  OR  PROFESSIONAL 

SCHOOL  .  18  (DE-10) 

3RD  YEAR  GRADUATE  OR  PROFESSIONAL 

SCHOOL  .  19  (DE-10) 

MORE  THAN  3  YEARS  GRADUATE/ 

PROFESSIONAL  SCHOOL  .  20  (DE-10) 

1ST  YEAR  OF  JUNIOR  OR 

COMMUNITY  COLLEGE  .  21  (DE-10) 

2ND  YEAR  OF  JUNIOR  OR 

COMMUNITY  COLLEGE  .  22  (DE-10) 

1ST  YEAR  OF  VOCATIONAL.  BUSINESS, 

OR  TRADE  SCHOOL  .  23  (DE-10) 

2ND  YEAR  OF  VOCATIONAL,  BUSINESS, 

OR  TRADE  SCHOOL .  24  (DE-10) 

MORE  THAN  2  YEARS  VOCATIONAL, 

BUSINESS,  OR  TRADE  SCHOOL  .  25  (DE-10) 

REFUSED  .  -7  (DE-10) 

DON’T  KNOW  .  -8  (DE-10) 

DE-10.  Do  you  have  a  regular  high  school  diploma,  a  GED,  an  ABE,  or 
other  kind  of  certificate  (of  high  school  completion)? 


REGULAR  HIGH  SCHOOL  DIPLOMA  . 

GED  (GENERAL  EDUCATIONAL 

DEVELOPMENT)  . 

ABE  (ADULT  BASIC  EDUCATION) 
CERTIFICATE  (E.G.,  CORRESPONDENCE, 

NIGHT  SCHOOL)  . 

SOME  OTHER  KIND  OF  CERTIFICATE  .... 

NONE  OF  THE  ABOVE  . 

REFUSED  . 

DON’T  KNOW  . 


DE-11.  Are  you  currently  employed  either  full-time  or  part-time? 

YES,  FULL-TIME  .  1  (DE-13) 

YES,  PART-TIME  .  2  (DE-12) 

NO  .  3  (DE-12) 

REFUSED  .  -7  (DE-12) 

DON’T  KNOW  .  -8  (DE-12) 


n 
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DE-1C.  Hava  you  avar  held  a  full-time  job?  [MORE  THAN  34  HOURS  PER  WEEK' 

YES  .  1 

NO  .  2 

REFUSED  .  -? 

DON'T  KNOW  .  -8 

DE-13.  How  aasy  or  difficult  is  it  for  someone  (YOUTH'S  NAME)  age  to  ge: 
a  full-tiaa  job  in  your  community?  Is  it - 

Almost  iapossibla  .  1 

Vary  difficult  .  2 

Somawhat  difficult,  or  .  3 

Not  difficult  at  all  .  4 

REFUSED  .  -7 

*  DON'T  KNOW  .  -8 


[QUESTION  BANX  ITEMS  OE-14,  DE-15,  DE-16,  DE-17,  DE-13, 
DE-19 ,  0E-20 ,  DE-21 ,  OE-22.  DE-23,  DE-24,  DE-25,  DE-26, 
DE-27 ,  DE-23  NOT  USED  IN  QUARTER  1] 


I  am  going  to  read  you  soma  incoma  eatagorias  and  ask  you  to 
choose  the  lattar  of  tha  alphabet  associated  with  the  category 
that  bast  describes  your  total  family  incoma  for  tha  year  1985. 
Include  all  soureas  of  income  in  your  response.  Please  tall  be 
only  tha  lattar. 

A- Lass  than  $5,000  .  1 

a-$5,001  to  $10,000  .  2 

C-$10,001  to  $20,000  .  3 

0-S20 , 001  to  $30,000  .  4 

E-S30 , 001  to  $40,000  .  5 

F-$40 , 001  to  $30,000  .  6 

G-$50 , 001  and  above  .  7 

REFUSED  .  -7 

DON'T  KNOW .  -3 


Hava  you  avar  served  in  tha  United  States  Armed  Forces? 


YES  . 

NO  . 

REFUSED  ... 
DON'T  KNOW 


(DE-31) 

(TERMINATE) 

(TERMINATE) 

(TERMINATE) 


DE-31.  What  month  and  year  did  you  begin  military  service? 


MONTH 

REFUSED  . .  . 
DON'T  KNOW 


V  V.V.V.V  .W-C-VA1>,y.  v  'VVV,. 
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IE-33.  Are  you  still  in  the  Araad  Forces? 

YES  .  1 

NO  .  2 

REFUSED  .  -1 

DON'T  KNOW  .  -3 


DE-3I.  What  aonth  and  year  (did/will)  you  finish  serving  in  t:-.e  Amec 
Forces? 


7 

3 


DE- 3  4'.  In  which  branch  of  the  Araed  Forces  (did  you  serve/are  you 
ser/mg)  ? 

Array  . 

Navy  . 

Marines  . . . 

Air  Force  . 

Coast  Guard 
REFUSED  . .  - 
DON'T  KNOW 


DE-35.  Were  you  part  of  the  Reserve  Officers  Training  Corps  (ROTC; ,  a 
National  Guard  unit  or  the  Army  Reserves? 


YES,  ROTC  .  1 

YES,  NATIONAL  GUARD  .  2 

YES,  ARMY  RESERVES  .  3 

no _ ; .  "4 

REFUSED  .  -7 

DON'T  KNOW  .  -8 


1  (DE-35) 

2  (TERMINATE) 

3  (TERMINATE) 

4  (TERMINATE) 

5  (TERMINATE) 
-7  (TERMINATE) 
-8  (TERMINATE) 


[QUESTION  SANK  ITEMS  DE-36,  DE-37,  DE-38,  DE-3S,  DE-40, 
DE-41,  DE-42  NOT  USED  IN  QUARTER  1] 
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